{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "name": "cifar_kd.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "toc_visible": true
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "piAVeOax6ph6"
      },
      "source": [
        "# Distilling knowledge in models pretrained on CIFAR-10/100 datasets, using ***torchdistill***"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "OqZF7kY-6zDh"
      },
      "source": [
        "## 1. Make sure you have access to GPU/TPU\n",
        "Google Colab: *Runtime* -> *Change runtime type* -> *Hardware accelarator*: \"GPU\" or \"TPU\""
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Jy7V9yQH6o3J",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "64c18d3d-2fef-4c6a-e1a5-37dbc3e3650e"
      },
      "source": [
        "!nvidia-smi"
      ],
      "execution_count": 1,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Mon May 24 23:17:08 2021       \n",
            "+-----------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 465.19.01    Driver Version: 460.32.03    CUDA Version: 11.2     |\n",
            "|-------------------------------+----------------------+----------------------+\n",
            "| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                               |                      |               MIG M. |\n",
            "|===============================+======================+======================|\n",
            "|   0  Tesla T4            Off  | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   37C    P8     9W /  70W |      0MiB / 15109MiB |      0%      Default |\n",
            "|                               |                      |                  N/A |\n",
            "+-------------------------------+----------------------+----------------------+\n",
            "                                                                               \n",
            "+-----------------------------------------------------------------------------+\n",
            "| Processes:                                                                  |\n",
            "|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |\n",
            "|        ID   ID                                                   Usage      |\n",
            "|=============================================================================|\n",
            "|  No running processes found                                                 |\n",
            "+-----------------------------------------------------------------------------+\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Ur2bTpuW64r5"
      },
      "source": [
        "## 2. Install ***torchdistill***"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "pJSCmbJH_yuC",
        "outputId": "f2bc2cc1-b068-4e72-ce4b-dbdbd658f179"
      },
      "source": [
        "!pip install torchdistill"
      ],
      "execution_count": 2,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Collecting torchdistill\n",
            "\u001b[?25l  Downloading https://files.pythonhosted.org/packages/1d/1e/98c4591040d5ba7b849432e4bc6a575a8c87aa228fa043cbfb1ead9695be/torchdistill-0.2.0-py3-none-any.whl (78kB)\n",
            "\r\u001b[K     |████▏                           | 10kB 20.8MB/s eta 0:00:01\r\u001b[K     |████████▍                       | 20kB 28.3MB/s eta 0:00:01\r\u001b[K     |████████████▋                   | 30kB 33.3MB/s eta 0:00:01\r\u001b[K     |████████████████▉               | 40kB 28.8MB/s eta 0:00:01\r\u001b[K     |█████████████████████           | 51kB 30.3MB/s eta 0:00:01\r\u001b[K     |█████████████████████████▏      | 61kB 32.6MB/s eta 0:00:01\r\u001b[K     |█████████████████████████████▍  | 71kB 27.1MB/s eta 0:00:01\r\u001b[K     |████████████████████████████████| 81kB 10.3MB/s \n",
            "\u001b[?25hRequirement already satisfied: torch>=1.7.1 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.8.1+cu101)\n",
            "Requirement already satisfied: scipy in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.4.1)\n",
            "Requirement already satisfied: cython in /usr/local/lib/python3.7/dist-packages (from torchdistill) (0.29.23)\n",
            "Requirement already satisfied: numpy in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.19.5)\n",
            "Requirement already satisfied: pycocotools>=2.0.1 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (2.0.2)\n",
            "Requirement already satisfied: torchvision>=0.8.2 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (0.9.1+cu101)\n",
            "Collecting pyyaml>=5.4.1\n",
            "\u001b[?25l  Downloading https://files.pythonhosted.org/packages/7a/a5/393c087efdc78091afa2af9f1378762f9821c9c1d7a22c5753fb5ac5f97a/PyYAML-5.4.1-cp37-cp37m-manylinux1_x86_64.whl (636kB)\n",
            "\u001b[K     |████████████████████████████████| 645kB 40.0MB/s \n",
            "\u001b[?25hRequirement already satisfied: typing-extensions in /usr/local/lib/python3.7/dist-packages (from torch>=1.7.1->torchdistill) (3.7.4.3)\n",
            "Requirement already satisfied: setuptools>=18.0 in /usr/local/lib/python3.7/dist-packages (from pycocotools>=2.0.1->torchdistill) (56.1.0)\n",
            "Requirement already satisfied: matplotlib>=2.1.0 in /usr/local/lib/python3.7/dist-packages (from pycocotools>=2.0.1->torchdistill) (3.2.2)\n",
            "Requirement already satisfied: pillow>=4.1.1 in /usr/local/lib/python3.7/dist-packages (from torchvision>=0.8.2->torchdistill) (7.1.2)\n",
            "Requirement already satisfied: python-dateutil>=2.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (2.8.1)\n",
            "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (1.3.1)\n",
            "Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (0.10.0)\n",
            "Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (2.4.7)\n",
            "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.7/dist-packages (from python-dateutil>=2.1->matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (1.15.0)\n",
            "Installing collected packages: pyyaml, torchdistill\n",
            "  Found existing installation: PyYAML 3.13\n",
            "    Uninstalling PyYAML-3.13:\n",
            "      Successfully uninstalled PyYAML-3.13\n",
            "Successfully installed pyyaml-5.4.1 torchdistill-0.2.0\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qOKnpfrD7DFC"
      },
      "source": [
        "## 3. Clone ***torchdistill*** repository to use its example code and configuration files"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "xa4hqLn57Hkz",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "48599057-873d-4cd0-b5f8-7c260a82ab6a"
      },
      "source": [
        "!git clone https://github.com/yoshitomo-matsubara/torchdistill.git"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Cloning into 'torchdistill'...\n",
            "remote: Enumerating objects: 5091, done.\u001b[K\n",
            "remote: Counting objects: 100% (873/873), done.\u001b[K\n",
            "remote: Compressing objects: 100% (313/313), done.\u001b[K\n",
            "remote: Total 5091 (delta 504), reused 856 (delta 498), pack-reused 4218\u001b[K\n",
            "Receiving objects: 100% (5091/5091), 1.09 MiB | 21.46 MiB/s, done.\n",
            "Resolving deltas: 100% (3118/3118), done.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gGrp0OmZ7a_u"
      },
      "source": [
        "## 4. Distill knowledge in models pretrained on CIFAR-10"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "VETfswVJ7Xj0"
      },
      "source": [
        "Note that the hyperparameters of ResNet, WRN (Wide ResNet), and DenseNet-BC were chosen based on either train/val (splitting 50k samples into train:val = 45k:5k) or cross-validation, according to the original papers.  \n",
        "For the final run (once the hyperparameters are finalized), the authors used all the training images (50k samples).  \n",
        "- ResNet: https://github.com/facebookarchive/fb.resnet.torch\n",
        "- WRN (Wide ResNet): https://github.com/szagoruyko/wide-residual-networks\n",
        "- DenseNet-BC: https://github.com/liuzhuang13/DenseNet\n",
        "\n",
        "The following examples demonstrate how to 1) tune hyperparameter and 2) do final-run with ResNet-20 on CIFAR-10 dataset, respectively."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0TpYnaQs781n"
      },
      "source": [
        "### 4.1 Hyperparameter tuning based on train:val = 45k:5k\n",
        "Let's start with a small **student model**, ResNet-20, with a pretrained DenseNet-BC (k=12, depth=100) as a **teacher model** for tutorial.  \n",
        "\n",
        "Open `torchdistill/configs/sample/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.yaml` and update hyperparameters as you wish e.g., number of epochs (*num_epochs*), batch size (*batch_size* in *train_data_loader* entry), learning rate (*lr* within *optimizer* entry), and so on.  \n",
        "By default, the hyperparameters in the example config are identical to those in the final run config.\n",
        "  \n",
        "You will find a lot of module names from [PyTorch documentation](https://pytorch.org/docs/stable/index.html) and [torchvision](https://pytorch.org/docs/stable/torchvision/) such as [`SGD`](https://pytorch.org/docs/stable/optim.html#torch.optim.SGD), [`MultiStepLR`](https://pytorch.org/docs/stable/optim.html#torch.optim.lr_scheduler.MultiStepLR), [`CrossEntropyLoss`](https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html#torch.nn.CrossEntropyLoss), [`CIFAR10`](https://pytorch.org/docs/stable/torchvision/datasets.html#torchvision.datasets.CIFAR10), [`RandomCrop`](https://pytorch.org/docs/stable/torchvision/transforms.html#torchvision.transforms.RandomCrop) (, and more). You can update their parameters or replace such modules with other modules in the packages. For instance, `SGD` could be replaced with [`Adam`](https://pytorch.org/docs/stable/optim.html#torch.optim.Adam), and then you will change the parameters under `params` (at least delete `momentum` entry as the parameter is not for `Adam`). "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "gy9Yr2tB8avA",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "d016438b-fd69-46e5-8a32-6d0720940531"
      },
      "source": [
        "!python torchdistill/examples/image_classification.py --config torchdistill/configs/sample/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.yaml --log log/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.log"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "2021/05/23 21:49:33\tINFO\ttorchdistill.common.main_util\tNot using distributed mode\n",
            "2021/05/23 21:49:33\tINFO\t__main__\tNamespace(adjust_lr=False, config='torchdistill/configs/sample/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.yaml', device='cuda', dist_url='env://', log='log/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.log', seed=None, start_epoch=0, student_only=False, sync_bn=False, test_only=False, world_size=1)\n",
            "2021/05/23 21:49:33\tINFO\ttorchdistill.datasets.util\tLoading dummy data\n",
            "Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to ./resource/dataset/cifar10/cifar-10-python.tar.gz\n",
            "170499072it [00:03, 46340554.83it/s]                   \n",
            "Extracting ./resource/dataset/cifar10/cifar-10-python.tar.gz to ./resource/dataset/cifar10\n",
            "2021/05/23 21:49:40\tINFO\ttorchdistill.datasets.util\tSplitting `dummy` dataset (50000 samples in total)\n",
            "2021/05/23 21:49:40\tINFO\ttorchdistill.datasets.util\tnew dataset_id: `cifar10/train` (45000 samples)\n",
            "2021/05/23 21:49:40\tINFO\ttorchdistill.datasets.util\tnew dataset_id: `cifar10/val` (5000 samples)\n",
            "2021/05/23 21:49:40\tINFO\ttorchdistill.datasets.util\tdataset_id `dummy`: 6.670923233032227 sec\n",
            "2021/05/23 21:49:40\tINFO\ttorchdistill.datasets.util\tLoading test data\n",
            "Files already downloaded and verified\n",
            "2021/05/23 21:49:41\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/test`: 0.7367708683013916 sec\n",
            "Downloading: \"https://github.com/yoshitomo-matsubara/torchdistill/releases/download/v0.1.1/cifar10-densenet_bc_k12_depth100.pt\" to /root/.cache/torch/hub/checkpoints/cifar10-densenet_bc_k12_depth100.pt\n",
            "100% 3.23M/3.23M [00:00<00:00, 18.7MB/s]\n",
            "2021/05/23 21:49:41\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/teacher/cifar10-densenet_bc_k12_depth100.pt`\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/kd/cifar10-resnet20_from_densenet_bc_k12_depth100-hyperparameter_tuning.pt`\n",
            "2021/05/23 21:49:52\tINFO\t__main__\tStart training\n",
            "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py:477: UserWarning: This DataLoader will create 16 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.\n",
            "  cpuset_checked))\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.models.util\t[teacher model]\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.models.util\tUsing the original teacher model\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.models.util\t[student model]\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.models.util\tUsing the original student model\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.core.distillation\tLoss = 1.0 * OrgLoss\n",
            "2021/05/23 21:49:52\tINFO\ttorchdistill.core.distillation\tFreezing the whole teacher model\n",
            "2021/05/23 21:49:54\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [  0/352]  eta: 0:09:14  lr: 0.1  img/s: 143.51249406899612  loss: 4.8621 (4.8621)  time: 1.5743  data: 0.6824  max mem: 700\n",
            "2021/05/23 21:50:05\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [100/352]  eta: 0:00:31  lr: 0.1  img/s: 1167.3568382898134  loss: 3.6618 (4.0757)  time: 0.1091  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:50:16\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1151.811615283946  loss: 3.2220 (3.7516)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:50:27\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.094266587928  loss: 2.8615 (3.4995)  time: 0.1113  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:50:33\tINFO\ttorchdistill.misc.log\tEpoch: [0] Total time: 0:00:40\n",
            "2021/05/23 21:50:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 50.7812 (50.7812)  acc5: 86.7188 (86.7188)  time: 0.6121  data: 0.5359  max mem: 700\n",
            "2021/05/23 21:50:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:50:34\tINFO\t__main__\t * Acc@1 50.6600\tAcc@5 93.1600\n",
            "\n",
            "2021/05/23 21:50:34\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 0.0000 -> 50.6600)\n",
            "2021/05/23 21:50:36\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [  0/352]  eta: 0:06:23  lr: 0.1  img/s: 322.2264974680832  loss: 2.7486 (2.7486)  time: 1.0909  data: 0.6936  max mem: 700\n",
            "2021/05/23 21:50:47\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1152.8850788960565  loss: 2.4536 (2.5329)  time: 0.1114  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:50:58\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1169.248369301266  loss: 2.3250 (2.4427)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:51:09\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1169.7425991088644  loss: 2.1935 (2.3618)  time: 0.1099  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:51:15\tINFO\ttorchdistill.misc.log\tEpoch: [1] Total time: 0:00:40\n",
            "2021/05/23 21:51:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 59.3750 (59.3750)  acc5: 95.3125 (95.3125)  time: 0.5602  data: 0.5074  max mem: 700\n",
            "2021/05/23 21:51:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:51:16\tINFO\t__main__\t * Acc@1 61.7600\tAcc@5 96.5800\n",
            "\n",
            "2021/05/23 21:51:16\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 50.6600 -> 61.7600)\n",
            "2021/05/23 21:51:17\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [  0/352]  eta: 0:05:20  lr: 0.1  img/s: 348.86689249911785  loss: 2.3506 (2.3506)  time: 0.9101  data: 0.5431  max mem: 700\n",
            "2021/05/23 21:51:28\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1167.422836975974  loss: 1.8211 (1.9439)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:51:39\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1156.2669055854444  loss: 1.8455 (1.9060)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:51:50\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.0693287815307  loss: 1.7649 (1.8715)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:51:56\tINFO\ttorchdistill.misc.log\tEpoch: [2] Total time: 0:00:39\n",
            "2021/05/23 21:51:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 57.8125 (57.8125)  acc5: 93.7500 (93.7500)  time: 0.6143  data: 0.5950  max mem: 700\n",
            "2021/05/23 21:51:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:51:58\tINFO\t__main__\t * Acc@1 66.8200\tAcc@5 97.4000\n",
            "\n",
            "2021/05/23 21:51:58\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 61.7600 -> 66.8200)\n",
            "2021/05/23 21:51:59\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [  0/352]  eta: 0:06:05  lr: 0.1  img/s: 375.4258030589525  loss: 1.6398 (1.6398)  time: 1.0395  data: 0.6986  max mem: 700\n",
            "2021/05/23 21:52:10\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1159.4507417301782  loss: 1.5838 (1.6209)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:52:21\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.1940919501415  loss: 1.4390 (1.5832)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:52:32\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1166.0738864791956  loss: 1.6720 (1.5795)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:52:38\tINFO\ttorchdistill.misc.log\tEpoch: [3] Total time: 0:00:40\n",
            "2021/05/23 21:52:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 63.2812 (63.2812)  acc5: 97.6562 (97.6562)  time: 0.7707  data: 0.7406  max mem: 700\n",
            "2021/05/23 21:52:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:52:40\tINFO\t__main__\t * Acc@1 70.9600\tAcc@5 97.8000\n",
            "\n",
            "2021/05/23 21:52:40\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 66.8200 -> 70.9600)\n",
            "2021/05/23 21:52:41\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [  0/352]  eta: 0:05:40  lr: 0.1  img/s: 290.9166196139036  loss: 1.3586 (1.3586)  time: 0.9680  data: 0.5279  max mem: 700\n",
            "2021/05/23 21:52:52\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1168.8563397944322  loss: 1.2889 (1.3280)  time: 0.1110  data: 0.0005  max mem: 700\n",
            "2021/05/23 21:53:03\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1157.4559856156366  loss: 1.4070 (1.3540)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:53:14\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.7437840500127  loss: 1.2864 (1.3644)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:53:20\tINFO\ttorchdistill.misc.log\tEpoch: [4] Total time: 0:00:39\n",
            "2021/05/23 21:53:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 68.7500 (68.7500)  acc5: 98.4375 (98.4375)  time: 0.5386  data: 0.4974  max mem: 700\n",
            "2021/05/23 21:53:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:53:21\tINFO\t__main__\t * Acc@1 74.4200\tAcc@5 98.5200\n",
            "\n",
            "2021/05/23 21:53:21\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 70.9600 -> 74.4200)\n",
            "2021/05/23 21:53:22\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [  0/352]  eta: 0:06:08  lr: 0.1  img/s: 362.6033698477848  loss: 1.3762 (1.3762)  time: 1.0464  data: 0.6933  max mem: 700\n",
            "2021/05/23 21:53:33\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1142.4729996595165  loss: 1.2442 (1.1964)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:53:44\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.0304124703455  loss: 1.2033 (1.2240)  time: 0.1107  data: 0.0005  max mem: 700\n",
            "2021/05/23 21:53:55\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1150.6784891409416  loss: 1.2291 (1.2314)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:54:01\tINFO\ttorchdistill.misc.log\tEpoch: [5] Total time: 0:00:40\n",
            "2021/05/23 21:54:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 63.2812 (63.2812)  acc5: 97.6562 (97.6562)  time: 0.5500  data: 0.5214  max mem: 700\n",
            "2021/05/23 21:54:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:54:03\tINFO\t__main__\t * Acc@1 73.6000\tAcc@5 98.1600\n",
            "\n",
            "2021/05/23 21:54:04\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [  0/352]  eta: 0:05:45  lr: 0.1  img/s: 343.76040861618213  loss: 1.2177 (1.2177)  time: 0.9822  data: 0.6098  max mem: 700\n",
            "2021/05/23 21:54:15\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1159.408175253101  loss: 1.0939 (1.0862)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:54:26\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1164.6143527135314  loss: 1.0539 (1.0879)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:54:37\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.0396410653264  loss: 1.1023 (1.1026)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:54:43\tINFO\ttorchdistill.misc.log\tEpoch: [6] Total time: 0:00:40\n",
            "2021/05/23 21:54:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 67.9688 (67.9688)  acc5: 99.2188 (99.2188)  time: 0.5987  data: 0.5380  max mem: 700\n",
            "2021/05/23 21:54:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:54:45\tINFO\t__main__\t * Acc@1 77.7800\tAcc@5 99.1400\n",
            "\n",
            "2021/05/23 21:54:45\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 74.4200 -> 77.7800)\n",
            "2021/05/23 21:54:46\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [  0/352]  eta: 0:05:37  lr: 0.1  img/s: 286.99100278025907  loss: 0.8634 (0.8634)  time: 0.9581  data: 0.5121  max mem: 700\n",
            "2021/05/23 21:54:57\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1157.5408352253005  loss: 0.9268 (0.9394)  time: 0.1110  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:55:08\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.517717945112  loss: 1.0641 (0.9561)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:55:19\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.390358224027  loss: 0.9709 (0.9747)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:55:25\tINFO\ttorchdistill.misc.log\tEpoch: [7] Total time: 0:00:40\n",
            "2021/05/23 21:55:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 69.5312 (69.5312)  acc5: 98.4375 (98.4375)  time: 0.5980  data: 0.5643  max mem: 700\n",
            "2021/05/23 21:55:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:55:26\tINFO\t__main__\t * Acc@1 79.6600\tAcc@5 98.8000\n",
            "\n",
            "2021/05/23 21:55:26\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 77.7800 -> 79.6600)\n",
            "2021/05/23 21:55:27\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [  0/352]  eta: 0:05:41  lr: 0.1  img/s: 295.19065103814427  loss: 0.8480 (0.8480)  time: 0.9690  data: 0.5193  max mem: 700\n",
            "2021/05/23 21:55:39\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.9311757961152  loss: 0.8156 (0.8352)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:55:50\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.0856533596316  loss: 0.9124 (0.8694)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:56:01\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1156.4736348929735  loss: 1.0752 (0.8970)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:56:06\tINFO\ttorchdistill.misc.log\tEpoch: [8] Total time: 0:00:40\n",
            "2021/05/23 21:56:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 69.5312 (69.5312)  acc5: 98.4375 (98.4375)  time: 0.6949  data: 0.6698  max mem: 700\n",
            "2021/05/23 21:56:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:56:08\tINFO\t__main__\t * Acc@1 77.3000\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 21:56:09\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [  0/352]  eta: 0:05:47  lr: 0.1  img/s: 291.5191047940088  loss: 0.7409 (0.7409)  time: 0.9871  data: 0.5479  max mem: 700\n",
            "2021/05/23 21:56:20\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1161.1383882032849  loss: 0.6645 (0.7454)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:56:31\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1144.9899698648076  loss: 0.8539 (0.7980)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:56:42\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.652159977824  loss: 0.8744 (0.8120)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:56:48\tINFO\ttorchdistill.misc.log\tEpoch: [9] Total time: 0:00:40\n",
            "2021/05/23 21:56:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 65.6250 (65.6250)  acc5: 99.2188 (99.2188)  time: 0.5008  data: 0.4678  max mem: 700\n",
            "2021/05/23 21:56:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:56:50\tINFO\t__main__\t * Acc@1 79.8400\tAcc@5 98.7200\n",
            "\n",
            "2021/05/23 21:56:50\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 79.6600 -> 79.8400)\n",
            "2021/05/23 21:56:51\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [  0/352]  eta: 0:05:38  lr: 0.1  img/s: 304.4789079226086  loss: 0.9302 (0.9302)  time: 0.9616  data: 0.5412  max mem: 700\n",
            "2021/05/23 21:57:02\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.5492059088701  loss: 0.6889 (0.6797)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:57:13\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.508336644954  loss: 0.7288 (0.7062)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:57:24\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1156.7327735727506  loss: 0.8593 (0.7353)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:57:30\tINFO\ttorchdistill.misc.log\tEpoch: [10] Total time: 0:00:39\n",
            "2021/05/23 21:57:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 70.3125 (70.3125)  acc5: 97.6562 (97.6562)  time: 0.5534  data: 0.5323  max mem: 700\n",
            "2021/05/23 21:57:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:57:31\tINFO\t__main__\t * Acc@1 77.6000\tAcc@5 98.6000\n",
            "\n",
            "2021/05/23 21:57:32\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [  0/352]  eta: 0:05:35  lr: 0.1  img/s: 324.9906547260887  loss: 0.6467 (0.6467)  time: 0.9531  data: 0.5593  max mem: 700\n",
            "2021/05/23 21:57:44\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.4331483530402  loss: 0.5908 (0.6044)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:57:55\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1167.8062846130085  loss: 0.6602 (0.6408)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:58:06\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.068915572786  loss: 0.6886 (0.6717)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:58:12\tINFO\ttorchdistill.misc.log\tEpoch: [11] Total time: 0:00:40\n",
            "2021/05/23 21:58:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 75.7812 (75.7812)  acc5: 98.4375 (98.4375)  time: 0.6266  data: 0.5516  max mem: 700\n",
            "2021/05/23 21:58:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:58:13\tINFO\t__main__\t * Acc@1 81.2200\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 21:58:13\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 79.8400 -> 81.2200)\n",
            "2021/05/23 21:58:14\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [  0/352]  eta: 0:06:16  lr: 0.1  img/s: 418.84891989792294  loss: 0.5337 (0.5337)  time: 1.0682  data: 0.7626  max mem: 700\n",
            "2021/05/23 21:58:25\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.9336603205336  loss: 0.5920 (0.5880)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:58:36\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1158.4675033230333  loss: 0.5802 (0.6100)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 21:58:47\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1158.3350313386625  loss: 0.6586 (0.6202)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:58:53\tINFO\ttorchdistill.misc.log\tEpoch: [12] Total time: 0:00:40\n",
            "2021/05/23 21:58:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 68.7500 (68.7500)  acc5: 97.6562 (97.6562)  time: 0.6106  data: 0.5770  max mem: 700\n",
            "2021/05/23 21:58:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:58:55\tINFO\t__main__\t * Acc@1 76.5800\tAcc@5 97.3000\n",
            "\n",
            "2021/05/23 21:58:56\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [  0/352]  eta: 0:06:17  lr: 0.1  img/s: 386.14805757506883  loss: 0.6458 (0.6458)  time: 1.0713  data: 0.7398  max mem: 700\n",
            "2021/05/23 21:59:07\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.412144669505  loss: 0.4941 (0.4875)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:59:18\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1146.7974059485462  loss: 0.5975 (0.5345)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 21:59:29\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1161.7238154384127  loss: 0.5864 (0.5643)  time: 0.1103  data: 0.0003  max mem: 700\n",
            "2021/05/23 21:59:35\tINFO\ttorchdistill.misc.log\tEpoch: [13] Total time: 0:00:40\n",
            "2021/05/23 21:59:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 70.3125 (70.3125)  acc5: 99.2188 (99.2188)  time: 0.6240  data: 0.5997  max mem: 700\n",
            "2021/05/23 21:59:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 21:59:37\tINFO\t__main__\t * Acc@1 80.6200\tAcc@5 98.9800\n",
            "\n",
            "2021/05/23 21:59:38\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [  0/352]  eta: 0:06:00  lr: 0.1  img/s: 321.21203955268396  loss: 0.4277 (0.4277)  time: 1.0249  data: 0.6264  max mem: 700\n",
            "2021/05/23 21:59:49\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1157.9053308803707  loss: 0.4635 (0.4776)  time: 0.1108  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:00:00\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.5934874357965  loss: 0.5415 (0.4969)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:00:11\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.9617833569198  loss: 0.6041 (0.5271)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:00:17\tINFO\ttorchdistill.misc.log\tEpoch: [14] Total time: 0:00:40\n",
            "2021/05/23 22:00:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.0938 (71.0938)  acc5: 98.4375 (98.4375)  time: 0.5954  data: 0.5332  max mem: 700\n",
            "2021/05/23 22:00:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:00:18\tINFO\t__main__\t * Acc@1 77.6800\tAcc@5 98.6600\n",
            "\n",
            "2021/05/23 22:00:19\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [  0/352]  eta: 0:05:31  lr: 0.1  img/s: 315.4103005930787  loss: 0.5077 (0.5077)  time: 0.9429  data: 0.5370  max mem: 700\n",
            "2021/05/23 22:00:30\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.9720148081717  loss: 0.4454 (0.4324)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:00:41\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.0758582922251  loss: 0.5166 (0.4452)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:00:53\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1152.0637242279101  loss: 0.5968 (0.4792)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:00:58\tINFO\ttorchdistill.misc.log\tEpoch: [15] Total time: 0:00:40\n",
            "2021/05/23 22:00:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 71.8750 (71.8750)  acc5: 99.2188 (99.2188)  time: 0.5354  data: 0.5015  max mem: 700\n",
            "2021/05/23 22:01:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:01:00\tINFO\t__main__\t * Acc@1 78.6200\tAcc@5 98.6000\n",
            "\n",
            "2021/05/23 22:01:01\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [  0/352]  eta: 0:05:26  lr: 0.1  img/s: 321.00979883332417  loss: 0.4077 (0.4077)  time: 0.9268  data: 0.5280  max mem: 700\n",
            "2021/05/23 22:01:12\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1158.5350007013303  loss: 0.4233 (0.4458)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:01:23\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1150.2495206141282  loss: 0.4006 (0.4523)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:01:34\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.4684627192605  loss: 0.5045 (0.4638)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:01:40\tINFO\ttorchdistill.misc.log\tEpoch: [16] Total time: 0:00:40\n",
            "2021/05/23 22:01:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 68.7500 (68.7500)  acc5: 99.2188 (99.2188)  time: 0.5583  data: 0.5352  max mem: 700\n",
            "2021/05/23 22:01:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:01:42\tINFO\t__main__\t * Acc@1 81.7000\tAcc@5 98.9800\n",
            "\n",
            "2021/05/23 22:01:42\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 81.2200 -> 81.7000)\n",
            "2021/05/23 22:01:43\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [  0/352]  eta: 0:05:34  lr: 0.1  img/s: 288.8387354321948  loss: 0.2345 (0.2345)  time: 0.9490  data: 0.5058  max mem: 700\n",
            "2021/05/23 22:01:54\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1165.7953569776707  loss: 0.3992 (0.3823)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:02:05\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.241068073154  loss: 0.4145 (0.3931)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:02:16\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.9972077023224  loss: 0.4984 (0.4211)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:02:22\tINFO\ttorchdistill.misc.log\tEpoch: [17] Total time: 0:00:40\n",
            "2021/05/23 22:02:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5982  data: 0.5458  max mem: 700\n",
            "2021/05/23 22:02:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:02:23\tINFO\t__main__\t * Acc@1 81.7200\tAcc@5 99.1400\n",
            "\n",
            "2021/05/23 22:02:23\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 81.7000 -> 81.7200)\n",
            "2021/05/23 22:02:24\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [  0/352]  eta: 0:05:41  lr: 0.1  img/s: 273.7621836891313  loss: 0.3281 (0.3281)  time: 0.9700  data: 0.5024  max mem: 700\n",
            "2021/05/23 22:02:36\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1152.6746807912211  loss: 0.3425 (0.3631)  time: 0.1110  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:02:47\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1154.2061516565873  loss: 0.4044 (0.3798)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:02:58\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.5909828222634  loss: 0.4256 (0.4000)  time: 0.1109  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:03:03\tINFO\ttorchdistill.misc.log\tEpoch: [18] Total time: 0:00:40\n",
            "2021/05/23 22:03:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 98.4375 (98.4375)  time: 0.5727  data: 0.5147  max mem: 700\n",
            "2021/05/23 22:03:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:03:05\tINFO\t__main__\t * Acc@1 79.8200\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:03:06\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [  0/352]  eta: 0:05:23  lr: 0.1  img/s: 297.97556123898835  loss: 0.3417 (0.3417)  time: 0.9192  data: 0.4895  max mem: 700\n",
            "2021/05/23 22:03:17\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.2433738669786  loss: 0.3162 (0.3360)  time: 0.1112  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:03:28\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.952619025976  loss: 0.3315 (0.3429)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:03:39\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1154.7076123637194  loss: 0.4060 (0.3589)  time: 0.1108  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:03:45\tINFO\ttorchdistill.misc.log\tEpoch: [19] Total time: 0:00:40\n",
            "2021/05/23 22:03:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:31  acc1: 64.8438 (64.8438)  acc5: 100.0000 (100.0000)  time: 0.7996  data: 0.7647  max mem: 700\n",
            "2021/05/23 22:03:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:03:47\tINFO\t__main__\t * Acc@1 76.5600\tAcc@5 98.7200\n",
            "\n",
            "2021/05/23 22:03:48\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [  0/352]  eta: 0:05:29  lr: 0.1  img/s: 310.71345967422224  loss: 0.2290 (0.2290)  time: 0.9361  data: 0.5241  max mem: 700\n",
            "2021/05/23 22:03:59\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1158.155117925088  loss: 0.2759 (0.3306)  time: 0.1111  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:04:10\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1151.2460077325723  loss: 0.3424 (0.3339)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:04:21\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1170.0765679962687  loss: 0.4530 (0.3582)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:04:27\tINFO\ttorchdistill.misc.log\tEpoch: [20] Total time: 0:00:40\n",
            "2021/05/23 22:04:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 72.6562 (72.6562)  acc5: 97.6562 (97.6562)  time: 0.5559  data: 0.5148  max mem: 700\n",
            "2021/05/23 22:04:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:04:28\tINFO\t__main__\t * Acc@1 79.6000\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 22:04:30\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [  0/352]  eta: 0:06:03  lr: 0.1  img/s: 385.9409749329653  loss: 0.4368 (0.4368)  time: 1.0319  data: 0.7002  max mem: 700\n",
            "2021/05/23 22:04:41\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1165.5802207536192  loss: 0.3280 (0.3305)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:04:52\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1153.1822423081219  loss: 0.3440 (0.3396)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:05:03\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1154.1689318468134  loss: 0.3923 (0.3488)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:05:08\tINFO\ttorchdistill.misc.log\tEpoch: [21] Total time: 0:00:39\n",
            "2021/05/23 22:05:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5584  data: 0.5137  max mem: 700\n",
            "2021/05/23 22:05:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:05:10\tINFO\t__main__\t * Acc@1 80.5200\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 22:05:11\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [  0/352]  eta: 0:05:13  lr: 0.1  img/s: 363.80565260878166  loss: 0.3551 (0.3551)  time: 0.8893  data: 0.5374  max mem: 700\n",
            "2021/05/23 22:05:22\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1167.6183384080034  loss: 0.2847 (0.3137)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:05:33\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1164.1143491534833  loss: 0.3263 (0.3170)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:05:44\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1146.1975563255642  loss: 0.3177 (0.3261)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:05:50\tINFO\ttorchdistill.misc.log\tEpoch: [22] Total time: 0:00:39\n",
            "2021/05/23 22:05:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.8750 (71.8750)  acc5: 99.2188 (99.2188)  time: 0.5969  data: 0.5453  max mem: 700\n",
            "2021/05/23 22:05:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:05:52\tINFO\t__main__\t * Acc@1 82.0800\tAcc@5 99.1600\n",
            "\n",
            "2021/05/23 22:05:52\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 81.7200 -> 82.0800)\n",
            "2021/05/23 22:05:53\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [  0/352]  eta: 0:05:45  lr: 0.1  img/s: 312.8851755841928  loss: 0.2496 (0.2496)  time: 0.9827  data: 0.5736  max mem: 700\n",
            "2021/05/23 22:06:04\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1169.7629886895722  loss: 0.2891 (0.2779)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:06:15\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1154.0399217557663  loss: 0.2921 (0.2830)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:06:26\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.6194288585182  loss: 0.3185 (0.2859)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:06:32\tINFO\ttorchdistill.misc.log\tEpoch: [23] Total time: 0:00:39\n",
            "2021/05/23 22:06:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 72.6562 (72.6562)  acc5: 97.6562 (97.6562)  time: 0.5803  data: 0.5549  max mem: 700\n",
            "2021/05/23 22:06:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:06:33\tINFO\t__main__\t * Acc@1 80.0400\tAcc@5 98.4000\n",
            "\n",
            "2021/05/23 22:06:34\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [  0/352]  eta: 0:05:37  lr: 0.1  img/s: 288.92687208548267  loss: 0.2521 (0.2521)  time: 0.9590  data: 0.5159  max mem: 700\n",
            "2021/05/23 22:06:45\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.5287984530535  loss: 0.2189 (0.2566)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:06:56\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1155.833761044419  loss: 0.2909 (0.2641)  time: 0.1110  data: 0.0006  max mem: 700\n",
            "2021/05/23 22:07:07\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.7428096195163  loss: 0.3329 (0.2805)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:07:13\tINFO\ttorchdistill.misc.log\tEpoch: [24] Total time: 0:00:39\n",
            "2021/05/23 22:07:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 73.4375 (73.4375)  acc5: 100.0000 (100.0000)  time: 0.5350  data: 0.5045  max mem: 700\n",
            "2021/05/23 22:07:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:07:15\tINFO\t__main__\t * Acc@1 81.4400\tAcc@5 99.0200\n",
            "\n",
            "2021/05/23 22:07:16\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [  0/352]  eta: 0:05:20  lr: 0.1  img/s: 314.3366177795707  loss: 0.2850 (0.2850)  time: 0.9107  data: 0.5035  max mem: 700\n",
            "2021/05/23 22:07:27\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1160.2851746033118  loss: 0.2157 (0.2443)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:07:38\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1155.9507278642498  loss: 0.2672 (0.2477)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:07:49\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.0523256445874  loss: 0.2904 (0.2637)  time: 0.1107  data: 0.0004  max mem: 700\n",
            "2021/05/23 22:07:55\tINFO\ttorchdistill.misc.log\tEpoch: [25] Total time: 0:00:39\n",
            "2021/05/23 22:07:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5965  data: 0.5361  max mem: 700\n",
            "2021/05/23 22:07:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:07:56\tINFO\t__main__\t * Acc@1 80.3800\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 22:07:57\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [  0/352]  eta: 0:05:44  lr: 0.1  img/s: 314.85777088091055  loss: 0.2499 (0.2499)  time: 0.9793  data: 0.5727  max mem: 700\n",
            "2021/05/23 22:08:08\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1165.4992488646133  loss: 0.2824 (0.2912)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:08:20\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.4757822944134  loss: 0.2690 (0.2884)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:08:31\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.8846935125468  loss: 0.3556 (0.2993)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:08:36\tINFO\ttorchdistill.misc.log\tEpoch: [26] Total time: 0:00:39\n",
            "2021/05/23 22:08:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 75.7812 (75.7812)  acc5: 98.4375 (98.4375)  time: 0.6099  data: 0.5895  max mem: 700\n",
            "2021/05/23 22:08:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:08:38\tINFO\t__main__\t * Acc@1 79.6200\tAcc@5 98.5000\n",
            "\n",
            "2021/05/23 22:08:39\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [  0/352]  eta: 0:05:22  lr: 0.1  img/s: 315.21585265253043  loss: 0.2890 (0.2890)  time: 0.9170  data: 0.5108  max mem: 700\n",
            "2021/05/23 22:08:50\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1168.085775952099  loss: 0.2471 (0.2838)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:09:01\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1155.7566256708553  loss: 0.2336 (0.2711)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:09:12\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1154.6653934333854  loss: 0.2986 (0.2805)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:09:18\tINFO\ttorchdistill.misc.log\tEpoch: [27] Total time: 0:00:39\n",
            "2021/05/23 22:09:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 71.8750 (71.8750)  acc5: 98.4375 (98.4375)  time: 0.5402  data: 0.4996  max mem: 700\n",
            "2021/05/23 22:09:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:09:19\tINFO\t__main__\t * Acc@1 79.1600\tAcc@5 98.9600\n",
            "\n",
            "2021/05/23 22:09:20\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [  0/352]  eta: 0:05:35  lr: 0.1  img/s: 307.31388986358735  loss: 0.1993 (0.1993)  time: 0.9532  data: 0.5366  max mem: 700\n",
            "2021/05/23 22:09:32\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1152.2096023384534  loss: 0.2461 (0.2600)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:09:43\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.369473515707  loss: 0.2573 (0.2597)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:09:54\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1166.8950563482836  loss: 0.2774 (0.2679)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:09:59\tINFO\ttorchdistill.misc.log\tEpoch: [28] Total time: 0:00:39\n",
            "2021/05/23 22:10:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.6219  data: 0.6027  max mem: 700\n",
            "2021/05/23 22:10:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:10:01\tINFO\t__main__\t * Acc@1 81.1000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/23 22:10:02\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [  0/352]  eta: 0:05:36  lr: 0.1  img/s: 324.38467617779344  loss: 0.1965 (0.1965)  time: 0.9560  data: 0.5614  max mem: 700\n",
            "2021/05/23 22:10:13\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1159.986846000108  loss: 0.2226 (0.2233)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:10:24\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.6848929401344  loss: 0.2143 (0.2250)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:10:35\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1155.8039009687836  loss: 0.2758 (0.2365)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:10:41\tINFO\ttorchdistill.misc.log\tEpoch: [29] Total time: 0:00:39\n",
            "2021/05/23 22:10:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 74.2188 (74.2188)  acc5: 99.2188 (99.2188)  time: 0.7008  data: 0.6916  max mem: 700\n",
            "2021/05/23 22:10:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:10:43\tINFO\t__main__\t * Acc@1 82.2200\tAcc@5 99.0800\n",
            "\n",
            "2021/05/23 22:10:43\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 82.0800 -> 82.2200)\n",
            "2021/05/23 22:10:44\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [  0/352]  eta: 0:05:47  lr: 0.1  img/s: 278.75366218251696  loss: 0.1731 (0.1731)  time: 0.9877  data: 0.5285  max mem: 700\n",
            "2021/05/23 22:10:55\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.8619852411964  loss: 0.2434 (0.2274)  time: 0.1107  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:11:06\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1157.9977395280619  loss: 0.2467 (0.2331)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:11:17\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.641364222032  loss: 0.2521 (0.2461)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:11:23\tINFO\ttorchdistill.misc.log\tEpoch: [30] Total time: 0:00:39\n",
            "2021/05/23 22:11:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 98.4375 (98.4375)  time: 0.5712  data: 0.5246  max mem: 700\n",
            "2021/05/23 22:11:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:11:24\tINFO\t__main__\t * Acc@1 79.2000\tAcc@5 98.8000\n",
            "\n",
            "2021/05/23 22:11:25\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [  0/352]  eta: 0:06:06  lr: 0.1  img/s: 389.20357341441155  loss: 0.3928 (0.3928)  time: 1.0418  data: 0.7129  max mem: 700\n",
            "2021/05/23 22:11:36\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.4912088697986  loss: 0.2651 (0.2791)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:11:47\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1155.6745251338925  loss: 0.2603 (0.2720)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:11:58\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.9155243939845  loss: 0.2781 (0.2799)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:12:04\tINFO\ttorchdistill.misc.log\tEpoch: [31] Total time: 0:00:39\n",
            "2021/05/23 22:12:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 71.0938 (71.0938)  acc5: 97.6562 (97.6562)  time: 0.5150  data: 0.4856  max mem: 700\n",
            "2021/05/23 22:12:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:12:06\tINFO\t__main__\t * Acc@1 80.2000\tAcc@5 98.3800\n",
            "\n",
            "2021/05/23 22:12:07\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [  0/352]  eta: 0:06:06  lr: 0.1  img/s: 347.2224976668411  loss: 0.3450 (0.3450)  time: 1.0415  data: 0.6728  max mem: 700\n",
            "2021/05/23 22:12:18\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1171.138375892744  loss: 0.3195 (0.3432)  time: 0.1106  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:12:29\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1171.0055445285407  loss: 0.2981 (0.3307)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:12:40\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.265820039729  loss: 0.3268 (0.3333)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:12:46\tINFO\ttorchdistill.misc.log\tEpoch: [32] Total time: 0:00:39\n",
            "2021/05/23 22:12:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.0000 (75.0000)  acc5: 98.4375 (98.4375)  time: 0.5608  data: 0.5277  max mem: 700\n",
            "2021/05/23 22:12:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:12:47\tINFO\t__main__\t * Acc@1 77.8800\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 22:12:48\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [  0/352]  eta: 0:05:17  lr: 0.1  img/s: 310.87106634726683  loss: 0.2409 (0.2409)  time: 0.9030  data: 0.4912  max mem: 700\n",
            "2021/05/23 22:12:59\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1157.1541217092927  loss: 0.2447 (0.2910)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:13:10\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1150.8733563420437  loss: 0.2383 (0.2823)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:13:21\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.618534166213  loss: 0.3109 (0.2888)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:13:27\tINFO\ttorchdistill.misc.log\tEpoch: [33] Total time: 0:00:39\n",
            "2021/05/23 22:13:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 68.7500 (68.7500)  acc5: 98.4375 (98.4375)  time: 0.7036  data: 0.6835  max mem: 700\n",
            "2021/05/23 22:13:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:13:29\tINFO\t__main__\t * Acc@1 79.3800\tAcc@5 98.6800\n",
            "\n",
            "2021/05/23 22:13:30\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [  0/352]  eta: 0:06:16  lr: 0.1  img/s: 384.3349170975665  loss: 0.2539 (0.2539)  time: 1.0697  data: 0.7367  max mem: 700\n",
            "2021/05/23 22:13:41\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.7383668629818  loss: 0.2347 (0.2667)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:13:52\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1160.4206012294337  loss: 0.2204 (0.2579)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:14:03\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1143.0640887248046  loss: 0.2594 (0.2595)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:14:09\tINFO\ttorchdistill.misc.log\tEpoch: [34] Total time: 0:00:39\n",
            "2021/05/23 22:14:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 74.2188 (74.2188)  acc5: 96.8750 (96.8750)  time: 0.6738  data: 0.6412  max mem: 700\n",
            "2021/05/23 22:14:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:14:10\tINFO\t__main__\t * Acc@1 80.4200\tAcc@5 98.8800\n",
            "\n",
            "2021/05/23 22:14:11\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [  0/352]  eta: 0:05:47  lr: 0.1  img/s: 271.5652454538557  loss: 0.2070 (0.2070)  time: 0.9881  data: 0.5167  max mem: 700\n",
            "2021/05/23 22:14:23\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1169.9924204617025  loss: 0.1938 (0.2385)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:14:34\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1167.2781573008301  loss: 0.1839 (0.2212)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:14:45\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1156.3142226386242  loss: 0.2596 (0.2333)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:14:50\tINFO\ttorchdistill.misc.log\tEpoch: [35] Total time: 0:00:39\n",
            "2021/05/23 22:14:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 77.3438 (77.3438)  acc5: 98.4375 (98.4375)  time: 0.6020  data: 0.5717  max mem: 700\n",
            "2021/05/23 22:14:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:14:52\tINFO\t__main__\t * Acc@1 82.2000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/23 22:14:53\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [  0/352]  eta: 0:05:28  lr: 0.1  img/s: 309.9380159659344  loss: 0.2188 (0.2188)  time: 0.9331  data: 0.5201  max mem: 700\n",
            "2021/05/23 22:15:04\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1153.9431831126988  loss: 0.2261 (0.2393)  time: 0.1107  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:15:15\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1158.967670627245  loss: 0.2188 (0.2365)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:15:26\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1156.149874774152  loss: 0.2469 (0.2389)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:15:32\tINFO\ttorchdistill.misc.log\tEpoch: [36] Total time: 0:00:39\n",
            "2021/05/23 22:15:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 71.8750 (71.8750)  acc5: 100.0000 (100.0000)  time: 0.5635  data: 0.5454  max mem: 700\n",
            "2021/05/23 22:15:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:15:33\tINFO\t__main__\t * Acc@1 80.9800\tAcc@5 98.9000\n",
            "\n",
            "2021/05/23 22:15:34\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [  0/352]  eta: 0:05:23  lr: 0.1  img/s: 325.37039447767614  loss: 0.2892 (0.2892)  time: 0.9179  data: 0.5244  max mem: 700\n",
            "2021/05/23 22:15:46\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.3626794030472  loss: 0.2295 (0.2436)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:15:57\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1156.692898524808  loss: 0.2493 (0.2378)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:16:08\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.7430270722546  loss: 0.2831 (0.2464)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:16:13\tINFO\ttorchdistill.misc.log\tEpoch: [37] Total time: 0:00:39\n",
            "2021/05/23 22:16:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5798  data: 0.5358  max mem: 700\n",
            "2021/05/23 22:16:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:16:15\tINFO\t__main__\t * Acc@1 80.4800\tAcc@5 98.9000\n",
            "\n",
            "2021/05/23 22:16:16\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [  0/352]  eta: 0:05:09  lr: 0.1  img/s: 331.6349655714728  loss: 0.2678 (0.2678)  time: 0.8780  data: 0.4920  max mem: 700\n",
            "2021/05/23 22:16:27\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1157.1890400565585  loss: 0.2654 (0.2690)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:16:38\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.627384980179  loss: 0.2360 (0.2570)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:16:49\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1165.7396670437595  loss: 0.2670 (0.2653)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:16:55\tINFO\ttorchdistill.misc.log\tEpoch: [38] Total time: 0:00:39\n",
            "2021/05/23 22:16:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.0000 (75.0000)  acc5: 97.6562 (97.6562)  time: 0.5355  data: 0.5032  max mem: 700\n",
            "2021/05/23 22:16:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:16:57\tINFO\t__main__\t * Acc@1 80.7000\tAcc@5 98.0000\n",
            "\n",
            "2021/05/23 22:16:58\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [  0/352]  eta: 0:05:18  lr: 0.1  img/s: 320.44208481879326  loss: 0.2474 (0.2474)  time: 0.9053  data: 0.5058  max mem: 700\n",
            "2021/05/23 22:17:09\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1166.862085903438  loss: 0.2097 (0.2214)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:17:20\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1154.8814875524608  loss: 0.1972 (0.2196)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:17:31\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.330313299675  loss: 0.2366 (0.2287)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:17:37\tINFO\ttorchdistill.misc.log\tEpoch: [39] Total time: 0:00:39\n",
            "2021/05/23 22:17:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 71.8750 (71.8750)  acc5: 98.4375 (98.4375)  time: 0.5598  data: 0.5118  max mem: 700\n",
            "2021/05/23 22:17:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:17:38\tINFO\t__main__\t * Acc@1 79.4200\tAcc@5 98.1000\n",
            "\n",
            "2021/05/23 22:17:39\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [  0/352]  eta: 0:05:31  lr: 0.1  img/s: 315.47924828545456  loss: 0.2533 (0.2533)  time: 0.9404  data: 0.5346  max mem: 700\n",
            "2021/05/23 22:17:50\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1161.2514075717954  loss: 0.1804 (0.2078)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:18:01\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.4741890837824  loss: 0.1997 (0.2096)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:18:12\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.5560594728036  loss: 0.2464 (0.2160)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:18:18\tINFO\ttorchdistill.misc.log\tEpoch: [40] Total time: 0:00:39\n",
            "2021/05/23 22:18:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.5657  data: 0.5277  max mem: 700\n",
            "2021/05/23 22:18:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:18:20\tINFO\t__main__\t * Acc@1 82.3600\tAcc@5 98.6400\n",
            "\n",
            "2021/05/23 22:18:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 82.2200 -> 82.3600)\n",
            "2021/05/23 22:18:21\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [  0/352]  eta: 0:05:31  lr: 0.1  img/s: 298.7869848928811  loss: 0.2277 (0.2277)  time: 0.9416  data: 0.5131  max mem: 700\n",
            "2021/05/23 22:18:32\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1153.843980837716  loss: 0.1791 (0.2190)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:18:43\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.4767235198262  loss: 0.2084 (0.2169)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:18:54\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1151.4064948935604  loss: 0.2218 (0.2247)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:19:00\tINFO\ttorchdistill.misc.log\tEpoch: [41] Total time: 0:00:39\n",
            "2021/05/23 22:19:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 72.6562 (72.6562)  acc5: 98.4375 (98.4375)  time: 0.5314  data: 0.4882  max mem: 700\n",
            "2021/05/23 22:19:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:19:01\tINFO\t__main__\t * Acc@1 81.9200\tAcc@5 98.8000\n",
            "\n",
            "2021/05/23 22:19:02\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [  0/352]  eta: 0:05:35  lr: 0.1  img/s: 331.9811250868027  loss: 0.1971 (0.1971)  time: 0.9545  data: 0.5689  max mem: 700\n",
            "2021/05/23 22:19:13\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1150.0450103464675  loss: 0.2254 (0.2309)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:19:24\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1160.4607337085743  loss: 0.2559 (0.2392)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:19:35\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.63634594847  loss: 0.3747 (0.2723)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:19:41\tINFO\ttorchdistill.misc.log\tEpoch: [42] Total time: 0:00:39\n",
            "2021/05/23 22:19:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 71.8750 (71.8750)  acc5: 100.0000 (100.0000)  time: 0.6900  data: 0.6505  max mem: 700\n",
            "2021/05/23 22:19:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:19:43\tINFO\t__main__\t * Acc@1 81.4600\tAcc@5 98.6800\n",
            "\n",
            "2021/05/23 22:19:44\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [  0/352]  eta: 0:05:18  lr: 0.1  img/s: 336.1666485080505  loss: 0.1802 (0.1802)  time: 0.9037  data: 0.5229  max mem: 700\n",
            "2021/05/23 22:19:55\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1152.875176086583  loss: 0.2596 (0.2838)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:20:06\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.1584680747808  loss: 0.2550 (0.2730)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:20:17\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1154.8541608408154  loss: 0.2820 (0.2755)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:20:23\tINFO\ttorchdistill.misc.log\tEpoch: [43] Total time: 0:00:39\n",
            "2021/05/23 22:20:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 68.7500 (68.7500)  acc5: 97.6562 (97.6562)  time: 0.7052  data: 0.6565  max mem: 700\n",
            "2021/05/23 22:20:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:20:24\tINFO\t__main__\t * Acc@1 78.1200\tAcc@5 98.6000\n",
            "\n",
            "2021/05/23 22:20:25\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [  0/352]  eta: 0:05:39  lr: 0.1  img/s: 315.7187604382783  loss: 0.3311 (0.3311)  time: 0.9649  data: 0.5595  max mem: 700\n",
            "2021/05/23 22:20:36\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.6396168130227  loss: 0.2066 (0.2441)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:20:47\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1154.2086330625916  loss: 0.2438 (0.2382)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:20:59\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1170.2423485457823  loss: 0.2658 (0.2460)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:21:04\tINFO\ttorchdistill.misc.log\tEpoch: [44] Total time: 0:00:39\n",
            "2021/05/23 22:21:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 72.6562 (72.6562)  acc5: 100.0000 (100.0000)  time: 0.5713  data: 0.5120  max mem: 700\n",
            "2021/05/23 22:21:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:21:06\tINFO\t__main__\t * Acc@1 81.0400\tAcc@5 98.8800\n",
            "\n",
            "2021/05/23 22:21:07\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [  0/352]  eta: 0:06:08  lr: 0.1  img/s: 400.2490878538061  loss: 0.3903 (0.3903)  time: 1.0466  data: 0.7268  max mem: 700\n",
            "2021/05/23 22:21:18\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.255781803953  loss: 0.2264 (0.2346)  time: 0.1109  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:21:29\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.888886000823  loss: 0.2340 (0.2428)  time: 0.1101  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:21:40\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.7232317233097  loss: 0.2960 (0.2502)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:21:46\tINFO\ttorchdistill.misc.log\tEpoch: [45] Total time: 0:00:39\n",
            "2021/05/23 22:21:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 70.3125 (70.3125)  acc5: 99.2188 (99.2188)  time: 0.5334  data: 0.4948  max mem: 700\n",
            "2021/05/23 22:21:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:21:48\tINFO\t__main__\t * Acc@1 82.0800\tAcc@5 98.7000\n",
            "\n",
            "2021/05/23 22:21:48\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [  0/352]  eta: 0:05:17  lr: 0.1  img/s: 321.724059779557  loss: 0.3571 (0.3571)  time: 0.9013  data: 0.5034  max mem: 700\n",
            "2021/05/23 22:22:00\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.0778322988767  loss: 0.2187 (0.2356)  time: 0.1109  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:22:11\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.365148294296  loss: 0.2217 (0.2341)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:22:22\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1165.140071791622  loss: 0.2608 (0.2397)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:22:27\tINFO\ttorchdistill.misc.log\tEpoch: [46] Total time: 0:00:39\n",
            "2021/05/23 22:22:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.5245  data: 0.4835  max mem: 700\n",
            "2021/05/23 22:22:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:22:29\tINFO\t__main__\t * Acc@1 81.9800\tAcc@5 98.8800\n",
            "\n",
            "2021/05/23 22:22:30\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [  0/352]  eta: 0:05:27  lr: 0.1  img/s: 353.90024073639495  loss: 0.1985 (0.1985)  time: 0.9296  data: 0.5679  max mem: 700\n",
            "2021/05/23 22:22:41\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.8544160143251  loss: 0.2533 (0.2786)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:22:52\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1146.841501292376  loss: 0.2552 (0.2753)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:23:03\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.5133451688287  loss: 0.2495 (0.2809)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:23:09\tINFO\ttorchdistill.misc.log\tEpoch: [47] Total time: 0:00:39\n",
            "2021/05/23 22:23:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 73.4375 (73.4375)  acc5: 99.2188 (99.2188)  time: 0.5973  data: 0.5247  max mem: 700\n",
            "2021/05/23 22:23:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:23:11\tINFO\t__main__\t * Acc@1 80.2800\tAcc@5 98.6000\n",
            "\n",
            "2021/05/23 22:23:12\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [  0/352]  eta: 0:05:43  lr: 0.1  img/s: 349.9495560373317  loss: 0.2453 (0.2453)  time: 0.9747  data: 0.6089  max mem: 700\n",
            "2021/05/23 22:23:23\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.5840372409425  loss: 0.2104 (0.2332)  time: 0.1101  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:23:34\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.783102886648  loss: 0.1959 (0.2199)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:23:45\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1148.9227318835308  loss: 0.2581 (0.2281)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:23:51\tINFO\ttorchdistill.misc.log\tEpoch: [48] Total time: 0:00:39\n",
            "2021/05/23 22:23:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5878  data: 0.5648  max mem: 700\n",
            "2021/05/23 22:23:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:23:52\tINFO\t__main__\t * Acc@1 80.3800\tAcc@5 98.7600\n",
            "\n",
            "2021/05/23 22:23:53\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [  0/352]  eta: 0:05:25  lr: 0.1  img/s: 301.76714612526627  loss: 0.2272 (0.2272)  time: 0.9238  data: 0.4996  max mem: 700\n",
            "2021/05/23 22:24:04\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.6522492738154  loss: 0.1758 (0.1950)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:24:15\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1155.988062683829  loss: 0.1947 (0.1991)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:24:26\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.6046867481891  loss: 0.2138 (0.2062)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:24:32\tINFO\ttorchdistill.misc.log\tEpoch: [49] Total time: 0:00:39\n",
            "2021/05/23 22:24:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.6264  data: 0.5628  max mem: 700\n",
            "2021/05/23 22:24:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:24:34\tINFO\t__main__\t * Acc@1 80.6800\tAcc@5 98.2000\n",
            "\n",
            "2021/05/23 22:24:34\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [  0/352]  eta: 0:05:13  lr: 0.1  img/s: 319.5738181705625  loss: 0.1747 (0.1747)  time: 0.8902  data: 0.4897  max mem: 700\n",
            "2021/05/23 22:24:46\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.8208803609293  loss: 0.1585 (0.1680)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:24:57\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.811430237959  loss: 0.1447 (0.1568)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:25:08\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.4130480949677  loss: 0.1466 (0.1531)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:25:14\tINFO\ttorchdistill.misc.log\tEpoch: [50] Total time: 0:00:39\n",
            "2021/05/23 22:25:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 81.2500 (81.2500)  acc5: 99.2188 (99.2188)  time: 0.5446  data: 0.5134  max mem: 700\n",
            "2021/05/23 22:25:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:25:15\tINFO\t__main__\t * Acc@1 83.5800\tAcc@5 99.1600\n",
            "\n",
            "2021/05/23 22:25:15\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 82.3600 -> 83.5800)\n",
            "2021/05/23 22:25:16\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [  0/352]  eta: 0:05:28  lr: 0.1  img/s: 341.34331626418316  loss: 0.1301 (0.1301)  time: 0.9343  data: 0.5592  max mem: 700\n",
            "2021/05/23 22:25:27\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.6748210631179  loss: 0.1198 (0.1249)  time: 0.1109  data: 0.0007  max mem: 700\n",
            "2021/05/23 22:25:38\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1172.5835846876619  loss: 0.1065 (0.1183)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:25:49\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1153.3655694527392  loss: 0.1110 (0.1151)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:25:55\tINFO\ttorchdistill.misc.log\tEpoch: [51] Total time: 0:00:39\n",
            "2021/05/23 22:25:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 80.4688 (80.4688)  acc5: 100.0000 (100.0000)  time: 0.5862  data: 0.5342  max mem: 700\n",
            "2021/05/23 22:25:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:25:57\tINFO\t__main__\t * Acc@1 85.7800\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 22:25:57\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 83.5800 -> 85.7800)\n",
            "2021/05/23 22:25:58\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [  0/352]  eta: 0:05:11  lr: 0.1  img/s: 353.2838038007211  loss: 0.0909 (0.0909)  time: 0.8862  data: 0.5238  max mem: 700\n",
            "2021/05/23 22:26:09\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1172.0741575192337  loss: 0.0911 (0.0914)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:26:20\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1165.6561421183133  loss: 0.0877 (0.0920)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:26:31\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1156.2370231259933  loss: 0.0868 (0.0907)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:26:37\tINFO\ttorchdistill.misc.log\tEpoch: [52] Total time: 0:00:39\n",
            "2021/05/23 22:26:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5469  data: 0.5081  max mem: 700\n",
            "2021/05/23 22:26:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:26:38\tINFO\t__main__\t * Acc@1 85.9600\tAcc@5 99.3200\n",
            "\n",
            "2021/05/23 22:26:38\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.7800 -> 85.9600)\n",
            "2021/05/23 22:26:39\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [  0/352]  eta: 0:05:10  lr: 0.1  img/s: 334.7511689490713  loss: 0.0853 (0.0853)  time: 0.8825  data: 0.5001  max mem: 700\n",
            "2021/05/23 22:26:50\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1166.3069406517682  loss: 0.0756 (0.0783)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:27:01\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1161.0806312433904  loss: 0.0716 (0.0791)  time: 0.1107  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:27:12\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.4324835487075  loss: 0.0773 (0.0787)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:27:18\tINFO\ttorchdistill.misc.log\tEpoch: [53] Total time: 0:00:39\n",
            "2021/05/23 22:27:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5714  data: 0.5106  max mem: 700\n",
            "2021/05/23 22:27:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:27:20\tINFO\t__main__\t * Acc@1 86.3800\tAcc@5 99.4800\n",
            "\n",
            "2021/05/23 22:27:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.9600 -> 86.3800)\n",
            "2021/05/23 22:27:21\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [  0/352]  eta: 0:05:33  lr: 0.1  img/s: 308.103646425454  loss: 0.0685 (0.0685)  time: 0.9479  data: 0.5324  max mem: 700\n",
            "2021/05/23 22:27:32\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1155.7566256708553  loss: 0.0683 (0.0711)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:27:43\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1157.031924087352  loss: 0.0703 (0.0728)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:27:54\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.4757841039275  loss: 0.0692 (0.0730)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:28:00\tINFO\ttorchdistill.misc.log\tEpoch: [54] Total time: 0:00:39\n",
            "2021/05/23 22:28:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5321  data: 0.5043  max mem: 700\n",
            "2021/05/23 22:28:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:28:01\tINFO\t__main__\t * Acc@1 85.7800\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 22:28:02\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [  0/352]  eta: 0:05:16  lr: 0.1  img/s: 318.7151633882166  loss: 0.0707 (0.0707)  time: 0.9000  data: 0.4983  max mem: 700\n",
            "2021/05/23 22:28:13\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1166.4919303673703  loss: 0.0647 (0.0690)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:28:24\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.8012222845246  loss: 0.0675 (0.0682)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:28:35\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.2620242943026  loss: 0.0770 (0.0691)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:28:41\tINFO\ttorchdistill.misc.log\tEpoch: [55] Total time: 0:00:39\n",
            "2021/05/23 22:28:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 80.4688 (80.4688)  acc5: 100.0000 (100.0000)  time: 0.5590  data: 0.5212  max mem: 700\n",
            "2021/05/23 22:28:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:28:43\tINFO\t__main__\t * Acc@1 86.1600\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:28:44\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [  0/352]  eta: 0:05:31  lr: 0.1  img/s: 302.95489401082887  loss: 0.0679 (0.0679)  time: 0.9408  data: 0.5182  max mem: 700\n",
            "2021/05/23 22:28:55\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1161.4574105603378  loss: 0.0650 (0.0679)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:29:06\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.050239745768  loss: 0.0707 (0.0690)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:29:17\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.365148294296  loss: 0.0696 (0.0691)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:29:23\tINFO\ttorchdistill.misc.log\tEpoch: [56] Total time: 0:00:39\n",
            "2021/05/23 22:29:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 80.4688 (80.4688)  acc5: 100.0000 (100.0000)  time: 0.5577  data: 0.5279  max mem: 700\n",
            "2021/05/23 22:29:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:29:24\tINFO\t__main__\t * Acc@1 86.0400\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:29:25\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [  0/352]  eta: 0:05:40  lr: 0.1  img/s: 373.5538958445531  loss: 0.0533 (0.0533)  time: 0.9676  data: 0.6249  max mem: 700\n",
            "2021/05/23 22:29:36\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1155.7889715095178  loss: 0.0638 (0.0653)  time: 0.1113  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:29:47\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.1231885470897  loss: 0.0670 (0.0654)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:29:58\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.6952016904072  loss: 0.0695 (0.0663)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:30:04\tINFO\ttorchdistill.misc.log\tEpoch: [57] Total time: 0:00:39\n",
            "2021/05/23 22:30:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.7015  data: 0.6782  max mem: 700\n",
            "2021/05/23 22:30:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:30:06\tINFO\t__main__\t * Acc@1 85.6800\tAcc@5 99.1200\n",
            "\n",
            "2021/05/23 22:30:07\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [  0/352]  eta: 0:05:17  lr: 0.1  img/s: 332.20832552115724  loss: 0.0548 (0.0548)  time: 0.9008  data: 0.5155  max mem: 700\n",
            "2021/05/23 22:30:18\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1173.0678226821424  loss: 0.0616 (0.0640)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:30:29\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.4532457379307  loss: 0.0620 (0.0650)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:30:40\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1161.3569121677601  loss: 0.0662 (0.0661)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:30:46\tINFO\ttorchdistill.misc.log\tEpoch: [58] Total time: 0:00:39\n",
            "2021/05/23 22:30:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.5693  data: 0.5375  max mem: 700\n",
            "2021/05/23 22:30:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:30:47\tINFO\t__main__\t * Acc@1 85.7200\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:30:48\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [  0/352]  eta: 0:05:06  lr: 0.1  img/s: 350.0775715859067  loss: 0.0557 (0.0557)  time: 0.8716  data: 0.5059  max mem: 700\n",
            "2021/05/23 22:30:59\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1169.1541563950905  loss: 0.0628 (0.0616)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:31:10\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1151.717720552271  loss: 0.0718 (0.0646)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:31:21\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.8903470839812  loss: 0.0776 (0.0683)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:31:27\tINFO\ttorchdistill.misc.log\tEpoch: [59] Total time: 0:00:39\n",
            "2021/05/23 22:31:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5337  data: 0.5166  max mem: 700\n",
            "2021/05/23 22:31:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:31:29\tINFO\t__main__\t * Acc@1 83.8400\tAcc@5 99.0200\n",
            "\n",
            "2021/05/23 22:31:30\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [  0/352]  eta: 0:05:29  lr: 0.1  img/s: 345.68231818661803  loss: 0.0861 (0.0861)  time: 0.9370  data: 0.5667  max mem: 700\n",
            "2021/05/23 22:31:41\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1156.9247106992782  loss: 0.4931 (0.2044)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:31:52\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1164.624458221796  loss: 0.9995 (0.6934)  time: 0.1106  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:32:03\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.1161053472358  loss: 0.8596 (0.7878)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:32:09\tINFO\ttorchdistill.misc.log\tEpoch: [60] Total time: 0:00:39\n",
            "2021/05/23 22:32:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 65.6250 (65.6250)  acc5: 97.6562 (97.6562)  time: 0.5700  data: 0.5131  max mem: 700\n",
            "2021/05/23 22:32:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:32:10\tINFO\t__main__\t * Acc@1 77.1200\tAcc@5 98.7600\n",
            "\n",
            "2021/05/23 22:32:11\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [  0/352]  eta: 0:05:26  lr: 0.1  img/s: 317.2418448651191  loss: 0.5906 (0.5906)  time: 0.9290  data: 0.5255  max mem: 700\n",
            "2021/05/23 22:32:22\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.4029463282402  loss: 0.6545 (0.6678)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:32:33\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.2139116568192  loss: 0.7750 (0.7014)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:32:44\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1166.3778886742894  loss: 0.6382 (0.6980)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:32:50\tINFO\ttorchdistill.misc.log\tEpoch: [61] Total time: 0:00:39\n",
            "2021/05/23 22:32:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 96.0938 (96.0938)  time: 0.5326  data: 0.4954  max mem: 700\n",
            "2021/05/23 22:32:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:32:52\tINFO\t__main__\t * Acc@1 75.6600\tAcc@5 97.7000\n",
            "\n",
            "2021/05/23 22:32:53\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [  0/352]  eta: 0:05:41  lr: 0.1  img/s: 312.1520365695255  loss: 0.4678 (0.4678)  time: 0.9693  data: 0.5592  max mem: 700\n",
            "2021/05/23 22:33:04\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1167.5040763735606  loss: 0.5384 (0.5584)  time: 0.1107  data: 0.0004  max mem: 700\n",
            "2021/05/23 22:33:15\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1152.3332567788298  loss: 0.5345 (0.5458)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:33:26\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1163.0249211465807  loss: 0.5758 (0.5663)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:33:32\tINFO\ttorchdistill.misc.log\tEpoch: [62] Total time: 0:00:39\n",
            "2021/05/23 22:33:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 74.2188 (74.2188)  acc5: 99.2188 (99.2188)  time: 0.5385  data: 0.5090  max mem: 700\n",
            "2021/05/23 22:33:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:33:33\tINFO\t__main__\t * Acc@1 80.6600\tAcc@5 98.3400\n",
            "\n",
            "2021/05/23 22:33:34\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [  0/352]  eta: 0:06:02  lr: 0.1  img/s: 402.92465448595993  loss: 0.3942 (0.3942)  time: 1.0285  data: 0.7108  max mem: 700\n",
            "2021/05/23 22:33:46\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.9681498808714  loss: 0.3476 (0.4036)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:33:57\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1158.8225776511472  loss: 0.4178 (0.4100)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:34:08\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.1005295606126  loss: 0.4921 (0.4375)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:34:13\tINFO\ttorchdistill.misc.log\tEpoch: [63] Total time: 0:00:39\n",
            "2021/05/23 22:34:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 99.2188 (99.2188)  time: 0.5537  data: 0.5289  max mem: 700\n",
            "2021/05/23 22:34:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:34:15\tINFO\t__main__\t * Acc@1 82.8000\tAcc@5 99.1400\n",
            "\n",
            "2021/05/23 22:34:16\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [  0/352]  eta: 0:05:16  lr: 0.1  img/s: 362.3055678902537  loss: 0.3114 (0.3114)  time: 0.8989  data: 0.5456  max mem: 700\n",
            "2021/05/23 22:34:27\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1172.7961902265329  loss: 0.3282 (0.3466)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:34:38\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1172.107423167023  loss: 0.3646 (0.3518)  time: 0.1104  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:34:49\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1160.6238004544168  loss: 0.4168 (0.3763)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:34:55\tINFO\ttorchdistill.misc.log\tEpoch: [64] Total time: 0:00:39\n",
            "2021/05/23 22:34:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.6066  data: 0.5416  max mem: 700\n",
            "2021/05/23 22:34:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:34:56\tINFO\t__main__\t * Acc@1 81.6200\tAcc@5 99.2000\n",
            "\n",
            "2021/05/23 22:34:57\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [  0/352]  eta: 0:05:25  lr: 0.1  img/s: 321.1688043186952  loss: 0.2747 (0.2747)  time: 0.9239  data: 0.5253  max mem: 700\n",
            "2021/05/23 22:35:08\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1153.5712625080844  loss: 0.2799 (0.2865)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:35:20\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.2081345741121  loss: 0.2972 (0.2988)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:35:31\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1158.8976212062341  loss: 0.2882 (0.3061)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:35:36\tINFO\ttorchdistill.misc.log\tEpoch: [65] Total time: 0:00:39\n",
            "2021/05/23 22:35:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 73.4375 (73.4375)  acc5: 97.6562 (97.6562)  time: 0.5660  data: 0.5162  max mem: 700\n",
            "2021/05/23 22:35:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:35:38\tINFO\t__main__\t * Acc@1 81.1800\tAcc@5 98.9400\n",
            "\n",
            "2021/05/23 22:35:39\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [  0/352]  eta: 0:05:47  lr: 0.1  img/s: 318.5219118045787  loss: 0.2635 (0.2635)  time: 0.9881  data: 0.5862  max mem: 700\n",
            "2021/05/23 22:35:50\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1171.227798587644  loss: 0.2562 (0.2807)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:36:01\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1170.8038006843326  loss: 0.2626 (0.2779)  time: 0.1101  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:36:12\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.8114417627812  loss: 0.2912 (0.2771)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:36:18\tINFO\ttorchdistill.misc.log\tEpoch: [66] Total time: 0:00:39\n",
            "2021/05/23 22:36:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 73.4375 (73.4375)  acc5: 98.4375 (98.4375)  time: 0.5460  data: 0.5112  max mem: 700\n",
            "2021/05/23 22:36:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:36:19\tINFO\t__main__\t * Acc@1 78.3000\tAcc@5 98.4800\n",
            "\n",
            "2021/05/23 22:36:20\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [  0/352]  eta: 0:05:36  lr: 0.1  img/s: 334.1434236961539  loss: 0.2901 (0.2901)  time: 0.9557  data: 0.5726  max mem: 700\n",
            "2021/05/23 22:36:32\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1155.6098480771798  loss: 0.2028 (0.2410)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:36:43\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1160.2901898405892  loss: 0.2061 (0.2318)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:36:54\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1165.137543160604  loss: 0.2273 (0.2329)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:36:59\tINFO\ttorchdistill.misc.log\tEpoch: [67] Total time: 0:00:39\n",
            "2021/05/23 22:37:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 78.1250 (78.1250)  acc5: 98.4375 (98.4375)  time: 0.5386  data: 0.5130  max mem: 700\n",
            "2021/05/23 22:37:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:37:01\tINFO\t__main__\t * Acc@1 81.1600\tAcc@5 98.7400\n",
            "\n",
            "2021/05/23 22:37:02\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [  0/352]  eta: 0:05:30  lr: 0.1  img/s: 299.79105179367855  loss: 0.2154 (0.2154)  time: 0.9390  data: 0.5120  max mem: 700\n",
            "2021/05/23 22:37:13\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1159.468270011576  loss: 0.2222 (0.2344)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:37:24\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.1282283485891  loss: 0.2299 (0.2346)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:37:35\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.9892092748023  loss: 0.2648 (0.2445)  time: 0.1099  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:37:41\tINFO\ttorchdistill.misc.log\tEpoch: [68] Total time: 0:00:39\n",
            "2021/05/23 22:37:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.5131  data: 0.4713  max mem: 700\n",
            "2021/05/23 22:37:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:37:42\tINFO\t__main__\t * Acc@1 82.0800\tAcc@5 99.2200\n",
            "\n",
            "2021/05/23 22:37:43\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [  0/352]  eta: 0:05:19  lr: 0.1  img/s: 353.27078564072866  loss: 0.2127 (0.2127)  time: 0.9073  data: 0.5449  max mem: 700\n",
            "2021/05/23 22:37:54\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1162.9392656774612  loss: 0.1930 (0.2091)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:38:05\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1165.699168615394  loss: 0.1781 (0.2012)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:38:16\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1172.1406907031478  loss: 0.2047 (0.1990)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:38:22\tINFO\ttorchdistill.misc.log\tEpoch: [69] Total time: 0:00:39\n",
            "2021/05/23 22:38:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 71.0938 (71.0938)  acc5: 98.4375 (98.4375)  time: 0.6587  data: 0.6340  max mem: 700\n",
            "2021/05/23 22:38:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:38:24\tINFO\t__main__\t * Acc@1 80.5400\tAcc@5 98.5000\n",
            "\n",
            "2021/05/23 22:38:25\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [  0/352]  eta: 0:05:24  lr: 0.1  img/s: 307.53675546896886  loss: 0.2034 (0.2034)  time: 0.9221  data: 0.5058  max mem: 700\n",
            "2021/05/23 22:38:36\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.4382601007255  loss: 0.1683 (0.1902)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:38:47\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1157.615712859524  loss: 0.1429 (0.1746)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:38:58\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1161.826891614657  loss: 0.1413 (0.1684)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:39:04\tINFO\ttorchdistill.misc.log\tEpoch: [70] Total time: 0:00:39\n",
            "2021/05/23 22:39:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 79.6875 (79.6875)  acc5: 98.4375 (98.4375)  time: 0.5728  data: 0.5404  max mem: 700\n",
            "2021/05/23 22:39:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:39:05\tINFO\t__main__\t * Acc@1 84.8400\tAcc@5 99.0800\n",
            "\n",
            "2021/05/23 22:39:06\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [  0/352]  eta: 0:05:33  lr: 0.1  img/s: 329.1388662393985  loss: 0.1339 (0.1339)  time: 0.9486  data: 0.5597  max mem: 700\n",
            "2021/05/23 22:39:17\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.4653168345824  loss: 0.1158 (0.1227)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:39:29\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.251959742208  loss: 0.1080 (0.1182)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:39:40\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1155.410887147106  loss: 0.0958 (0.1143)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:39:45\tINFO\ttorchdistill.misc.log\tEpoch: [71] Total time: 0:00:39\n",
            "2021/05/23 22:39:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5650  data: 0.5330  max mem: 700\n",
            "2021/05/23 22:39:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:39:47\tINFO\t__main__\t * Acc@1 86.0200\tAcc@5 99.3200\n",
            "\n",
            "2021/05/23 22:39:48\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [  0/352]  eta: 0:05:38  lr: 0.1  img/s: 301.6649006317382  loss: 0.0923 (0.0923)  time: 0.9623  data: 0.5379  max mem: 700\n",
            "2021/05/23 22:39:59\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.3163190950415  loss: 0.0811 (0.0897)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:40:10\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1168.1416902744597  loss: 0.0858 (0.0876)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:40:21\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1161.0304124703455  loss: 0.0832 (0.0873)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:40:27\tINFO\ttorchdistill.misc.log\tEpoch: [72] Total time: 0:00:39\n",
            "2021/05/23 22:40:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6066  data: 0.5515  max mem: 700\n",
            "2021/05/23 22:40:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:40:28\tINFO\t__main__\t * Acc@1 85.8600\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 22:40:29\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [  0/352]  eta: 0:05:21  lr: 0.1  img/s: 309.71219376838457  loss: 0.0765 (0.0765)  time: 0.9125  data: 0.4992  max mem: 700\n",
            "2021/05/23 22:40:41\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.184028574521  loss: 0.0739 (0.0756)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:40:52\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1165.5802207536192  loss: 0.0733 (0.0755)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:41:03\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1155.5725376835207  loss: 0.0764 (0.0755)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:41:08\tINFO\ttorchdistill.misc.log\tEpoch: [73] Total time: 0:00:39\n",
            "2021/05/23 22:41:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.0312 (82.0312)  acc5: 99.2188 (99.2188)  time: 0.5988  data: 0.5697  max mem: 700\n",
            "2021/05/23 22:41:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:41:10\tINFO\t__main__\t * Acc@1 86.0600\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 22:41:11\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [  0/352]  eta: 0:05:27  lr: 0.1  img/s: 366.213311541699  loss: 0.0732 (0.0732)  time: 0.9297  data: 0.5801  max mem: 700\n",
            "2021/05/23 22:41:22\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1156.2967895895345  loss: 0.0669 (0.0700)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:41:33\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1150.4836879189454  loss: 0.0659 (0.0701)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:41:44\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1154.3947689257677  loss: 0.0707 (0.0707)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:41:50\tINFO\ttorchdistill.misc.log\tEpoch: [74] Total time: 0:00:39\n",
            "2021/05/23 22:41:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 99.2188 (99.2188)  time: 0.5790  data: 0.5264  max mem: 700\n",
            "2021/05/23 22:41:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:41:52\tINFO\t__main__\t * Acc@1 86.1000\tAcc@5 99.3000\n",
            "\n",
            "2021/05/23 22:41:53\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [  0/352]  eta: 0:05:11  lr: 0.1  img/s: 307.22367369922154  loss: 0.0751 (0.0751)  time: 0.8855  data: 0.4689  max mem: 700\n",
            "2021/05/23 22:42:04\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1151.685602184653  loss: 0.0605 (0.0658)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:42:15\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.3424602916639  loss: 0.0663 (0.0662)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:42:26\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1165.1122574540625  loss: 0.0662 (0.0667)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:42:32\tINFO\ttorchdistill.misc.log\tEpoch: [75] Total time: 0:00:39\n",
            "2021/05/23 22:42:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5130  data: 0.4833  max mem: 700\n",
            "2021/05/23 22:42:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:42:33\tINFO\t__main__\t * Acc@1 86.3200\tAcc@5 99.3400\n",
            "\n",
            "2021/05/23 22:42:34\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [  0/352]  eta: 0:04:42  lr: 0.1  img/s: 393.5112294941982  loss: 0.0654 (0.0654)  time: 0.8035  data: 0.4781  max mem: 700\n",
            "2021/05/23 22:42:45\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1158.2425688532583  loss: 0.0626 (0.0659)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:42:56\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1164.5082554638764  loss: 0.0636 (0.0653)  time: 0.1106  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:43:07\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.8788105892902  loss: 0.0684 (0.0665)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:43:13\tINFO\ttorchdistill.misc.log\tEpoch: [76] Total time: 0:00:39\n",
            "2021/05/23 22:43:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.7293  data: 0.6999  max mem: 700\n",
            "2021/05/23 22:43:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:43:15\tINFO\t__main__\t * Acc@1 85.6200\tAcc@5 99.5400\n",
            "\n",
            "2021/05/23 22:43:16\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [  0/352]  eta: 0:05:36  lr: 0.1  img/s: 325.2702524873708  loss: 0.0576 (0.0576)  time: 0.9566  data: 0.5630  max mem: 700\n",
            "2021/05/23 22:43:27\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1168.7494682761699  loss: 0.0610 (0.0617)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:43:38\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1165.9523299678362  loss: 0.0630 (0.0628)  time: 0.1101  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:43:49\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.7105717705156  loss: 0.0613 (0.0627)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:43:54\tINFO\ttorchdistill.misc.log\tEpoch: [77] Total time: 0:00:39\n",
            "2021/05/23 22:43:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5174  data: 0.4691  max mem: 700\n",
            "2021/05/23 22:43:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:43:56\tINFO\t__main__\t * Acc@1 86.3000\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 22:43:57\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [  0/352]  eta: 0:05:11  lr: 0.1  img/s: 344.5791862638378  loss: 0.0668 (0.0668)  time: 0.8852  data: 0.5137  max mem: 700\n",
            "2021/05/23 22:44:08\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1166.1980015639933  loss: 0.0632 (0.0617)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:44:19\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1160.709115162679  loss: 0.0642 (0.0623)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:44:30\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1155.9258393242774  loss: 0.0677 (0.0634)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:44:36\tINFO\ttorchdistill.misc.log\tEpoch: [78] Total time: 0:00:39\n",
            "2021/05/23 22:44:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.5784  data: 0.5139  max mem: 700\n",
            "2021/05/23 22:44:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:44:38\tINFO\t__main__\t * Acc@1 85.6800\tAcc@5 99.5200\n",
            "\n",
            "2021/05/23 22:44:38\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [  0/352]  eta: 0:05:22  lr: 0.1  img/s: 379.0982015691519  loss: 0.0586 (0.0586)  time: 0.9170  data: 0.5794  max mem: 700\n",
            "2021/05/23 22:44:50\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1167.9714224178254  loss: 0.0595 (0.0625)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:45:01\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1158.422509440069  loss: 0.0745 (0.0654)  time: 0.1105  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:45:12\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1173.178049084286  loss: 0.0690 (0.0674)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:45:17\tINFO\ttorchdistill.misc.log\tEpoch: [79] Total time: 0:00:39\n",
            "2021/05/23 22:45:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 80.4688 (80.4688)  acc5: 100.0000 (100.0000)  time: 0.5330  data: 0.5032  max mem: 700\n",
            "2021/05/23 22:45:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:45:19\tINFO\t__main__\t * Acc@1 84.7600\tAcc@5 99.0400\n",
            "\n",
            "2021/05/23 22:45:20\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [  0/352]  eta: 0:05:26  lr: 0.1  img/s: 321.6598716406321  loss: 0.0593 (0.0593)  time: 0.9276  data: 0.5296  max mem: 700\n",
            "2021/05/23 22:45:31\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1167.9714224178254  loss: 0.1185 (0.0932)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:45:42\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1160.7643254813358  loss: 1.1681 (0.4093)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:45:53\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1158.5475010789814  loss: 0.9032 (0.6193)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:45:59\tINFO\ttorchdistill.misc.log\tEpoch: [80] Total time: 0:00:39\n",
            "2021/05/23 22:45:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 67.9688 (67.9688)  acc5: 98.4375 (98.4375)  time: 0.5816  data: 0.5335  max mem: 700\n",
            "2021/05/23 22:46:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:46:00\tINFO\t__main__\t * Acc@1 74.1000\tAcc@5 98.4600\n",
            "\n",
            "2021/05/23 22:46:01\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [  0/352]  eta: 0:05:23  lr: 0.1  img/s: 327.1915292477173  loss: 0.7590 (0.7590)  time: 0.9178  data: 0.5265  max mem: 700\n",
            "2021/05/23 22:46:13\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1165.3499864335406  loss: 0.6452 (0.7291)  time: 0.1104  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:46:24\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1163.8291859691262  loss: 0.7340 (0.7245)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:46:35\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1162.0783736514918  loss: 0.6848 (0.7144)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:46:40\tINFO\ttorchdistill.misc.log\tEpoch: [81] Total time: 0:00:39\n",
            "2021/05/23 22:46:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.5531  data: 0.5179  max mem: 700\n",
            "2021/05/23 22:46:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:46:42\tINFO\t__main__\t * Acc@1 77.0200\tAcc@5 98.3000\n",
            "\n",
            "2021/05/23 22:46:43\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [  0/352]  eta: 0:05:20  lr: 0.1  img/s: 328.5438714588897  loss: 0.5357 (0.5357)  time: 0.9117  data: 0.5221  max mem: 700\n",
            "2021/05/23 22:46:54\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.9883733546278  loss: 0.5571 (0.5282)  time: 0.1107  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:47:05\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1167.7148437669925  loss: 0.5315 (0.5398)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:47:16\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1170.0893186786363  loss: 0.5023 (0.5482)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:47:22\tINFO\ttorchdistill.misc.log\tEpoch: [82] Total time: 0:00:39\n",
            "2021/05/23 22:47:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 74.2188 (74.2188)  acc5: 99.2188 (99.2188)  time: 0.6749  data: 0.6514  max mem: 700\n",
            "2021/05/23 22:47:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:47:23\tINFO\t__main__\t * Acc@1 81.0600\tAcc@5 98.9000\n",
            "\n",
            "2021/05/23 22:47:24\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [  0/352]  eta: 0:05:30  lr: 0.1  img/s: 341.2526232555065  loss: 0.5324 (0.5324)  time: 0.9403  data: 0.5652  max mem: 700\n",
            "2021/05/23 22:47:35\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1154.1887821132968  loss: 0.3945 (0.4146)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:47:47\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1168.439142764491  loss: 0.4199 (0.4041)  time: 0.1107  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:47:58\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1169.070141476257  loss: 0.4279 (0.4256)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:48:03\tINFO\ttorchdistill.misc.log\tEpoch: [83] Total time: 0:00:39\n",
            "2021/05/23 22:48:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 80.4688 (80.4688)  acc5: 98.4375 (98.4375)  time: 0.5793  data: 0.5467  max mem: 700\n",
            "2021/05/23 22:48:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:48:05\tINFO\t__main__\t * Acc@1 81.4800\tAcc@5 98.9400\n",
            "\n",
            "2021/05/23 22:48:06\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [  0/352]  eta: 0:05:23  lr: 0.1  img/s: 318.8804261314365  loss: 0.4386 (0.4386)  time: 0.9184  data: 0.5170  max mem: 700\n",
            "2021/05/23 22:48:17\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1166.9331014845568  loss: 0.3127 (0.3757)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:48:28\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1162.951861278688  loss: 0.3554 (0.3571)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:48:39\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1167.4659939981734  loss: 0.4224 (0.3669)  time: 0.1105  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:48:45\tINFO\ttorchdistill.misc.log\tEpoch: [84] Total time: 0:00:39\n",
            "2021/05/23 22:48:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 97.6562 (97.6562)  time: 0.5383  data: 0.4917  max mem: 700\n",
            "2021/05/23 22:48:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:48:47\tINFO\t__main__\t * Acc@1 82.5600\tAcc@5 99.0800\n",
            "\n",
            "2021/05/23 22:48:47\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [  0/352]  eta: 0:05:13  lr: 0.1  img/s: 316.96408352624377  loss: 0.3671 (0.3671)  time: 0.8914  data: 0.4875  max mem: 700\n",
            "2021/05/23 22:48:59\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1163.6727841008847  loss: 0.2525 (0.2857)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:49:10\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1168.9657761229778  loss: 0.2392 (0.2831)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:49:21\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1157.1915343048606  loss: 0.3026 (0.2905)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:49:26\tINFO\ttorchdistill.misc.log\tEpoch: [85] Total time: 0:00:39\n",
            "2021/05/23 22:49:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5760  data: 0.5331  max mem: 700\n",
            "2021/05/23 22:49:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:49:28\tINFO\t__main__\t * Acc@1 81.9000\tAcc@5 98.9400\n",
            "\n",
            "2021/05/23 22:49:29\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [  0/352]  eta: 0:05:39  lr: 0.1  img/s: 334.3065499986301  loss: 0.2184 (0.2184)  time: 0.9657  data: 0.5828  max mem: 700\n",
            "2021/05/23 22:49:40\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1162.7075553014454  loss: 0.1978 (0.2228)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:49:51\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1159.380633903949  loss: 0.2109 (0.2269)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:50:02\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1159.1728640829106  loss: 0.2144 (0.2271)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:50:08\tINFO\ttorchdistill.misc.log\tEpoch: [86] Total time: 0:00:39\n",
            "2021/05/23 22:50:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 99.2188 (99.2188)  time: 0.5365  data: 0.4995  max mem: 700\n",
            "2021/05/23 22:50:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:50:10\tINFO\t__main__\t * Acc@1 83.6800\tAcc@5 98.8400\n",
            "\n",
            "2021/05/23 22:50:10\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [  0/352]  eta: 0:05:20  lr: 0.1  img/s: 314.53956447180093  loss: 0.1824 (0.1824)  time: 0.9095  data: 0.5025  max mem: 700\n",
            "2021/05/23 22:50:22\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1167.9536361025785  loss: 0.1783 (0.2207)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:50:33\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1164.3516710403608  loss: 0.1819 (0.2071)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:50:44\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1153.3482251997361  loss: 0.2399 (0.2138)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:50:49\tINFO\ttorchdistill.misc.log\tEpoch: [87] Total time: 0:00:39\n",
            "2021/05/23 22:50:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 74.2188 (74.2188)  acc5: 96.8750 (96.8750)  time: 0.6055  data: 0.5926  max mem: 700\n",
            "2021/05/23 22:50:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:50:51\tINFO\t__main__\t * Acc@1 81.0000\tAcc@5 98.4200\n",
            "\n",
            "2021/05/23 22:50:52\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [  0/352]  eta: 0:05:21  lr: 0.1  img/s: 321.8922654732804  loss: 0.3478 (0.3478)  time: 0.9147  data: 0.5170  max mem: 700\n",
            "2021/05/23 22:51:03\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1164.2178499944703  loss: 0.1921 (0.2173)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:51:14\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1151.5176276036025  loss: 0.2010 (0.2166)  time: 0.1106  data: 0.0005  max mem: 700\n",
            "2021/05/23 22:51:25\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1164.7735348420451  loss: 0.2183 (0.2172)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:51:31\tINFO\ttorchdistill.misc.log\tEpoch: [88] Total time: 0:00:39\n",
            "2021/05/23 22:51:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 80.4688 (80.4688)  acc5: 100.0000 (100.0000)  time: 0.5537  data: 0.5211  max mem: 700\n",
            "2021/05/23 22:51:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:51:33\tINFO\t__main__\t * Acc@1 83.0600\tAcc@5 99.0600\n",
            "\n",
            "2021/05/23 22:51:34\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [  0/352]  eta: 0:05:22  lr: 0.1  img/s: 319.3369708036795  loss: 0.2344 (0.2344)  time: 0.9165  data: 0.5156  max mem: 700\n",
            "2021/05/23 22:51:45\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [100/352]  eta: 0:00:29  lr: 0.1  img/s: 1164.910011304731  loss: 0.1696 (0.1840)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:51:56\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1166.3145418127626  loss: 0.1619 (0.1752)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:52:07\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1168.0629034539027  loss: 0.1835 (0.1751)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:52:13\tINFO\ttorchdistill.misc.log\tEpoch: [89] Total time: 0:00:39\n",
            "2021/05/23 22:52:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5842  data: 0.5718  max mem: 700\n",
            "2021/05/23 22:52:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:52:14\tINFO\t__main__\t * Acc@1 83.8000\tAcc@5 99.2000\n",
            "\n",
            "2021/05/23 22:52:15\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [  0/352]  eta: 0:05:19  lr: 0.1  img/s: 351.1829350776778  loss: 0.1417 (0.1417)  time: 0.9085  data: 0.5440  max mem: 700\n",
            "2021/05/23 22:52:26\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [100/352]  eta: 0:00:30  lr: 0.1  img/s: 1141.8679496096086  loss: 0.1365 (0.1440)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:52:37\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [200/352]  eta: 0:00:17  lr: 0.1  img/s: 1158.462503830103  loss: 0.1256 (0.1369)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:52:48\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [300/352]  eta: 0:00:05  lr: 0.1  img/s: 1161.186104808726  loss: 0.1314 (0.1330)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:52:54\tINFO\ttorchdistill.misc.log\tEpoch: [90] Total time: 0:00:39\n",
            "2021/05/23 22:52:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 99.2188 (99.2188)  time: 0.5620  data: 0.5473  max mem: 700\n",
            "2021/05/23 22:52:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:52:56\tINFO\t__main__\t * Acc@1 85.9000\tAcc@5 99.1200\n",
            "\n",
            "2021/05/23 22:52:57\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [  0/352]  eta: 0:05:48  lr: 0.010000000000000002  img/s: 303.2985644370651  loss: 0.1021 (0.1021)  time: 0.9900  data: 0.5680  max mem: 700\n",
            "2021/05/23 22:53:08\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.9048394043211  loss: 0.0919 (0.0981)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:53:19\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1171.14348539318  loss: 0.0892 (0.0965)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:53:30\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1170.1428745793448  loss: 0.0840 (0.0948)  time: 0.1100  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:53:36\tINFO\ttorchdistill.misc.log\tEpoch: [91] Total time: 0:00:39\n",
            "2021/05/23 22:53:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 84.3750 (84.3750)  acc5: 99.2188 (99.2188)  time: 0.5133  data: 0.4860  max mem: 700\n",
            "2021/05/23 22:53:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:53:37\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.2000\n",
            "\n",
            "2021/05/23 22:53:37\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.3800 -> 86.8400)\n",
            "2021/05/23 22:53:38\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [  0/352]  eta: 0:05:59  lr: 0.010000000000000002  img/s: 340.4698548311098  loss: 0.0829 (0.0829)  time: 1.0225  data: 0.6465  max mem: 700\n",
            "2021/05/23 22:53:49\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1167.5548567389767  loss: 0.0851 (0.0835)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:54:00\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.9681498808714  loss: 0.0817 (0.0831)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:54:11\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.0733429438478  loss: 0.0798 (0.0835)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:54:17\tINFO\ttorchdistill.misc.log\tEpoch: [92] Total time: 0:00:39\n",
            "2021/05/23 22:54:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.7562  data: 0.7332  max mem: 700\n",
            "2021/05/23 22:54:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:54:19\tINFO\t__main__\t * Acc@1 87.2400\tAcc@5 99.3200\n",
            "\n",
            "2021/05/23 22:54:19\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.8400 -> 87.2400)\n",
            "2021/05/23 22:54:20\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [  0/352]  eta: 0:05:58  lr: 0.010000000000000002  img/s: 356.9584824619435  loss: 0.0812 (0.0812)  time: 1.0199  data: 0.6613  max mem: 700\n",
            "2021/05/23 22:54:31\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1152.2368040383055  loss: 0.0743 (0.0787)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:54:42\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1158.1950938536181  loss: 0.0786 (0.0801)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:54:53\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1161.3820351353866  loss: 0.0804 (0.0802)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:54:59\tINFO\ttorchdistill.misc.log\tEpoch: [93] Total time: 0:00:39\n",
            "2021/05/23 22:54:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5635  data: 0.5129  max mem: 700\n",
            "2021/05/23 22:55:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:55:00\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 22:55:01\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [  0/352]  eta: 0:05:04  lr: 0.010000000000000002  img/s: 344.9209973119247  loss: 0.0772 (0.0772)  time: 0.8658  data: 0.4947  max mem: 700\n",
            "2021/05/23 22:55:12\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1160.6589285212417  loss: 0.0783 (0.0798)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:55:24\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1158.4725028591158  loss: 0.0747 (0.0781)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:55:35\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1158.5250005934283  loss: 0.0774 (0.0776)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:55:40\tINFO\ttorchdistill.misc.log\tEpoch: [94] Total time: 0:00:39\n",
            "2021/05/23 22:55:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5282  data: 0.4932  max mem: 700\n",
            "2021/05/23 22:55:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:55:42\tINFO\t__main__\t * Acc@1 87.2000\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:55:43\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [  0/352]  eta: 0:05:09  lr: 0.010000000000000002  img/s: 363.02386526074355  loss: 0.0780 (0.0780)  time: 0.8797  data: 0.5271  max mem: 700\n",
            "2021/05/23 22:55:54\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.517717945112  loss: 0.0746 (0.0759)  time: 0.1109  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:56:05\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.2380474264587  loss: 0.0746 (0.0761)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:56:16\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1161.892266472755  loss: 0.0763 (0.0759)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:56:22\tINFO\ttorchdistill.misc.log\tEpoch: [95] Total time: 0:00:39\n",
            "2021/05/23 22:56:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5919  data: 0.5276  max mem: 700\n",
            "2021/05/23 22:56:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:56:23\tINFO\t__main__\t * Acc@1 87.0800\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 22:56:24\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [  0/352]  eta: 0:05:33  lr: 0.010000000000000002  img/s: 303.31090176182954  loss: 0.0754 (0.0754)  time: 0.9472  data: 0.5252  max mem: 700\n",
            "2021/05/23 22:56:36\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.4272592163131  loss: 0.0735 (0.0742)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:56:47\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1158.0776724160246  loss: 0.0758 (0.0739)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:56:58\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1168.5154370362632  loss: 0.0691 (0.0741)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:57:03\tINFO\ttorchdistill.misc.log\tEpoch: [96] Total time: 0:00:39\n",
            "2021/05/23 22:57:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5436  data: 0.5023  max mem: 700\n",
            "2021/05/23 22:57:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:57:05\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.3400\n",
            "\n",
            "2021/05/23 22:57:06\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [  0/352]  eta: 0:05:20  lr: 0.010000000000000002  img/s: 326.3069773548071  loss: 0.0683 (0.0683)  time: 0.9104  data: 0.5181  max mem: 700\n",
            "2021/05/23 22:57:17\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [100/352]  eta: 0:00:29  lr: 0.010000000000000002  img/s: 1150.1337046637675  loss: 0.0714 (0.0718)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:57:28\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1167.96125874278  loss: 0.0722 (0.0720)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:57:39\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1168.7545569529316  loss: 0.0762 (0.0727)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:57:45\tINFO\ttorchdistill.misc.log\tEpoch: [97] Total time: 0:00:39\n",
            "2021/05/23 22:57:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 84.3750 (84.3750)  acc5: 99.2188 (99.2188)  time: 0.5558  data: 0.5108  max mem: 700\n",
            "2021/05/23 22:57:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:57:46\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.3200\n",
            "\n",
            "2021/05/23 22:57:48\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [  0/352]  eta: 0:06:07  lr: 0.010000000000000002  img/s: 392.8549877505144  loss: 0.0697 (0.0697)  time: 1.0441  data: 0.7182  max mem: 700\n",
            "2021/05/23 22:57:59\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1155.1175447957726  loss: 0.0723 (0.0714)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:58:10\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.225423949343  loss: 0.0704 (0.0716)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:58:21\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.6446064790252  loss: 0.0681 (0.0714)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:58:26\tINFO\ttorchdistill.misc.log\tEpoch: [98] Total time: 0:00:39\n",
            "2021/05/23 22:58:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5295  data: 0.4891  max mem: 700\n",
            "2021/05/23 22:58:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:58:28\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.2800\n",
            "\n",
            "2021/05/23 22:58:29\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [  0/352]  eta: 0:05:24  lr: 0.010000000000000002  img/s: 332.0720911964274  loss: 0.0647 (0.0647)  time: 0.9210  data: 0.5356  max mem: 700\n",
            "2021/05/23 22:58:40\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1156.7352658545308  loss: 0.0711 (0.0709)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:58:51\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1167.021883117589  loss: 0.0721 (0.0716)  time: 0.1104  data: 0.0003  max mem: 700\n",
            "2021/05/23 22:59:02\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1152.1576753868276  loss: 0.0706 (0.0715)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:59:08\tINFO\ttorchdistill.misc.log\tEpoch: [99] Total time: 0:00:39\n",
            "2021/05/23 22:59:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5079  data: 0.4758  max mem: 700\n",
            "2021/05/23 22:59:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:59:09\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 22:59:10\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [  0/352]  eta: 0:05:22  lr: 0.010000000000000002  img/s: 293.64679525326426  loss: 0.0718 (0.0718)  time: 0.9157  data: 0.4798  max mem: 700\n",
            "2021/05/23 22:59:22\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1156.1971822492903  loss: 0.0672 (0.0695)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:59:33\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1165.7244798033641  loss: 0.0660 (0.0695)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 22:59:44\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1163.1332681937636  loss: 0.0689 (0.0695)  time: 0.1101  data: 0.0002  max mem: 700\n",
            "2021/05/23 22:59:49\tINFO\ttorchdistill.misc.log\tEpoch: [100] Total time: 0:00:39\n",
            "2021/05/23 22:59:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5698  data: 0.5149  max mem: 700\n",
            "2021/05/23 22:59:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 22:59:51\tINFO\t__main__\t * Acc@1 87.1400\tAcc@5 99.3000\n",
            "\n",
            "2021/05/23 22:59:52\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [  0/352]  eta: 0:05:45  lr: 0.010000000000000002  img/s: 286.3071796121605  loss: 0.0702 (0.0702)  time: 0.9807  data: 0.5336  max mem: 700\n",
            "2021/05/23 23:00:03\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.0756091705937  loss: 0.0651 (0.0686)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:00:14\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1171.7211462493726  loss: 0.0667 (0.0685)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:00:25\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1161.967708143954  loss: 0.0678 (0.0682)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:00:31\tINFO\ttorchdistill.misc.log\tEpoch: [101] Total time: 0:00:39\n",
            "2021/05/23 23:00:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5203  data: 0.4763  max mem: 700\n",
            "2021/05/23 23:00:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:00:33\tINFO\t__main__\t * Acc@1 86.9800\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:00:33\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [  0/352]  eta: 0:05:00  lr: 0.010000000000000002  img/s: 365.2846551040223  loss: 0.0639 (0.0639)  time: 0.8534  data: 0.5030  max mem: 700\n",
            "2021/05/23 23:00:45\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [100/352]  eta: 0:00:29  lr: 0.010000000000000002  img/s: 1162.1085588120698  loss: 0.0657 (0.0663)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:00:56\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1169.0243202459678  loss: 0.0651 (0.0670)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:01:07\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.400429563681  loss: 0.0659 (0.0673)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:01:12\tINFO\ttorchdistill.misc.log\tEpoch: [102] Total time: 0:00:39\n",
            "2021/05/23 23:01:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.7536  data: 0.7192  max mem: 700\n",
            "2021/05/23 23:01:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:01:14\tINFO\t__main__\t * Acc@1 87.2000\tAcc@5 99.3400\n",
            "\n",
            "2021/05/23 23:01:15\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [  0/352]  eta: 0:05:16  lr: 0.010000000000000002  img/s: 347.92523965305395  loss: 0.0562 (0.0562)  time: 0.8982  data: 0.5303  max mem: 700\n",
            "2021/05/23 23:01:26\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1166.1321412901348  loss: 0.0670 (0.0672)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:01:37\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1156.3092417138168  loss: 0.0673 (0.0674)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:01:48\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1166.7581143958673  loss: 0.0634 (0.0671)  time: 0.1102  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:01:54\tINFO\ttorchdistill.misc.log\tEpoch: [103] Total time: 0:00:39\n",
            "2021/05/23 23:01:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.6025  data: 0.5693  max mem: 700\n",
            "2021/05/23 23:01:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:01:56\tINFO\t__main__\t * Acc@1 87.1200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:01:56\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [  0/352]  eta: 0:05:33  lr: 0.010000000000000002  img/s: 325.7209823243262  loss: 0.0644 (0.0644)  time: 0.9474  data: 0.5543  max mem: 700\n",
            "2021/05/23 23:02:08\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1165.018709881821  loss: 0.0642 (0.0642)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:02:19\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1159.808924682866  loss: 0.0638 (0.0653)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:02:30\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.453283908168  loss: 0.0670 (0.0657)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:02:35\tINFO\ttorchdistill.misc.log\tEpoch: [104] Total time: 0:00:39\n",
            "2021/05/23 23:02:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5562  data: 0.5186  max mem: 700\n",
            "2021/05/23 23:02:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:02:37\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:02:38\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [  0/352]  eta: 0:05:09  lr: 0.010000000000000002  img/s: 354.5792417576829  loss: 0.0726 (0.0726)  time: 0.8794  data: 0.5184  max mem: 700\n",
            "2021/05/23 23:02:49\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1154.0175960139204  loss: 0.0666 (0.0651)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:03:00\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1154.0845758310547  loss: 0.0631 (0.0651)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:03:11\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1171.2150230808834  loss: 0.0637 (0.0653)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:03:17\tINFO\ttorchdistill.misc.log\tEpoch: [105] Total time: 0:00:39\n",
            "2021/05/23 23:03:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5555  data: 0.5192  max mem: 700\n",
            "2021/05/23 23:03:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:03:19\tINFO\t__main__\t * Acc@1 87.2200\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:03:19\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [  0/352]  eta: 0:05:01  lr: 0.010000000000000002  img/s: 325.7893717367717  loss: 0.0794 (0.0794)  time: 0.8578  data: 0.4648  max mem: 700\n",
            "2021/05/23 23:03:31\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1160.1121754632381  loss: 0.0671 (0.0646)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:03:42\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1168.7214813460291  loss: 0.0622 (0.0646)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:03:53\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1167.0396410653264  loss: 0.0673 (0.0648)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:03:58\tINFO\ttorchdistill.misc.log\tEpoch: [106] Total time: 0:00:39\n",
            "2021/05/23 23:03:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.6464  data: 0.6182  max mem: 700\n",
            "2021/05/23 23:04:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:04:00\tINFO\t__main__\t * Acc@1 87.1600\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:04:01\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [  0/352]  eta: 0:05:21  lr: 0.010000000000000002  img/s: 332.7523200644591  loss: 0.0571 (0.0571)  time: 0.9138  data: 0.5291  max mem: 700\n",
            "2021/05/23 23:04:12\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.5629525938075  loss: 0.0587 (0.0637)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:04:23\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1165.5954042353635  loss: 0.0609 (0.0643)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:04:34\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.767992584218  loss: 0.0632 (0.0644)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:04:40\tINFO\ttorchdistill.misc.log\tEpoch: [107] Total time: 0:00:39\n",
            "2021/05/23 23:04:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5419  data: 0.5028  max mem: 700\n",
            "2021/05/23 23:04:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:04:42\tINFO\t__main__\t * Acc@1 87.1400\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:04:42\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [  0/352]  eta: 0:05:23  lr: 0.010000000000000002  img/s: 353.33449077654217  loss: 0.0859 (0.0859)  time: 0.9177  data: 0.5554  max mem: 700\n",
            "2021/05/23 23:04:54\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1156.388941660474  loss: 0.0617 (0.0629)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:05:05\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1159.1203076185686  loss: 0.0602 (0.0634)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:05:16\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1158.062684158984  loss: 0.0591 (0.0630)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:05:21\tINFO\ttorchdistill.misc.log\tEpoch: [108] Total time: 0:00:39\n",
            "2021/05/23 23:05:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.7627  data: 0.7494  max mem: 700\n",
            "2021/05/23 23:05:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:05:23\tINFO\t__main__\t * Acc@1 87.2200\tAcc@5 99.3400\n",
            "\n",
            "2021/05/23 23:05:24\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [  0/352]  eta: 0:05:24  lr: 0.010000000000000002  img/s: 310.4486234335778  loss: 0.0617 (0.0617)  time: 0.9209  data: 0.5086  max mem: 700\n",
            "2021/05/23 23:05:35\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [100/352]  eta: 0:00:29  lr: 0.010000000000000002  img/s: 1163.4786015828847  loss: 0.0620 (0.0639)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:05:46\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1163.9124492698325  loss: 0.0615 (0.0635)  time: 0.1104  data: 0.0004  max mem: 700\n",
            "2021/05/23 23:05:57\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1166.55783128865  loss: 0.0639 (0.0633)  time: 0.1107  data: 0.0006  max mem: 700\n",
            "2021/05/23 23:06:03\tINFO\ttorchdistill.misc.log\tEpoch: [109] Total time: 0:00:39\n",
            "2021/05/23 23:06:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5786  data: 0.5258  max mem: 700\n",
            "2021/05/23 23:06:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:06:05\tINFO\t__main__\t * Acc@1 87.0800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:06:06\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [  0/352]  eta: 0:05:26  lr: 0.010000000000000002  img/s: 289.3694551808778  loss: 0.0722 (0.0722)  time: 0.9262  data: 0.4838  max mem: 700\n",
            "2021/05/23 23:06:17\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1170.18878353931  loss: 0.0579 (0.0616)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:06:28\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1165.7649799904893  loss: 0.0613 (0.0617)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:06:39\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1157.12918132285  loss: 0.0637 (0.0621)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:06:45\tINFO\ttorchdistill.misc.log\tEpoch: [110] Total time: 0:00:39\n",
            "2021/05/23 23:06:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5101  data: 0.4804  max mem: 700\n",
            "2021/05/23 23:06:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:06:46\tINFO\t__main__\t * Acc@1 87.1400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:06:47\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [  0/352]  eta: 0:05:19  lr: 0.010000000000000002  img/s: 349.15458390211955  loss: 0.0584 (0.0584)  time: 0.9071  data: 0.5405  max mem: 700\n",
            "2021/05/23 23:06:58\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1163.5819894017056  loss: 0.0583 (0.0614)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:07:09\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1170.6659398215886  loss: 0.0586 (0.0616)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:07:20\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.1538394932916  loss: 0.0598 (0.0614)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:07:26\tINFO\ttorchdistill.misc.log\tEpoch: [111] Total time: 0:00:39\n",
            "2021/05/23 23:07:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.6870  data: 0.6307  max mem: 700\n",
            "2021/05/23 23:07:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/23 23:07:28\tINFO\t__main__\t * Acc@1 87.1600\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:07:29\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [  0/352]  eta: 0:05:40  lr: 0.010000000000000002  img/s: 353.34635083816534  loss: 0.0595 (0.0595)  time: 0.9685  data: 0.6062  max mem: 700\n",
            "2021/05/23 23:07:40\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1152.9816402047088  loss: 0.0610 (0.0624)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:07:51\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1153.1822423081219  loss: 0.0617 (0.0618)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:08:02\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1165.5372030367698  loss: 0.0572 (0.0616)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:08:08\tINFO\ttorchdistill.misc.log\tEpoch: [112] Total time: 0:00:39\n",
            "2021/05/23 23:08:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5031  data: 0.4549  max mem: 700\n",
            "2021/05/23 23:08:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:08:10\tINFO\t__main__\t * Acc@1 87.2000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:08:10\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [  0/352]  eta: 0:05:07  lr: 0.010000000000000002  img/s: 314.85573969889737  loss: 0.0640 (0.0640)  time: 0.8743  data: 0.4678  max mem: 700\n",
            "2021/05/23 23:08:22\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [100/352]  eta: 0:00:29  lr: 0.010000000000000002  img/s: 1166.7530430889663  loss: 0.0583 (0.0586)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:08:33\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.745738001536  loss: 0.0581 (0.0597)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:08:44\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1154.811931193657  loss: 0.0593 (0.0602)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:08:49\tINFO\ttorchdistill.misc.log\tEpoch: [113] Total time: 0:00:39\n",
            "2021/05/23 23:08:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5403  data: 0.4930  max mem: 700\n",
            "2021/05/23 23:08:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:08:51\tINFO\t__main__\t * Acc@1 86.7800\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:08:52\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [  0/352]  eta: 0:05:34  lr: 0.010000000000000002  img/s: 318.45200569199295  loss: 0.0499 (0.0499)  time: 0.9507  data: 0.5487  max mem: 700\n",
            "2021/05/23 23:09:03\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1162.7755476863433  loss: 0.0589 (0.0597)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:09:14\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.8999008403616  loss: 0.0576 (0.0601)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:09:25\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1167.1918742173368  loss: 0.0592 (0.0599)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:09:31\tINFO\ttorchdistill.misc.log\tEpoch: [114] Total time: 0:00:39\n",
            "2021/05/23 23:09:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5540  data: 0.5193  max mem: 700\n",
            "2021/05/23 23:09:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:09:33\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:09:34\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [  0/352]  eta: 0:06:00  lr: 0.010000000000000002  img/s: 376.5121347409998  loss: 0.0551 (0.0551)  time: 1.0249  data: 0.6849  max mem: 700\n",
            "2021/05/23 23:09:45\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1171.5523899305192  loss: 0.0561 (0.0599)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:09:56\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1171.7262608361634  loss: 0.0601 (0.0604)  time: 0.1103  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:10:07\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1158.4850018881157  loss: 0.0594 (0.0604)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:10:12\tINFO\ttorchdistill.misc.log\tEpoch: [115] Total time: 0:00:39\n",
            "2021/05/23 23:10:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 84.3750 (84.3750)  acc5: 99.2188 (99.2188)  time: 0.5356  data: 0.4966  max mem: 700\n",
            "2021/05/23 23:10:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:10:14\tINFO\t__main__\t * Acc@1 87.1400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:10:15\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [  0/352]  eta: 0:06:08  lr: 0.010000000000000002  img/s: 384.8266659403139  loss: 0.0584 (0.0584)  time: 1.0464  data: 0.7138  max mem: 700\n",
            "2021/05/23 23:10:26\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1156.1573441181158  loss: 0.0589 (0.0596)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:10:37\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1157.7180612940233  loss: 0.0573 (0.0590)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:10:48\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1163.6626951012543  loss: 0.0581 (0.0592)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:10:54\tINFO\ttorchdistill.misc.log\tEpoch: [116] Total time: 0:00:39\n",
            "2021/05/23 23:10:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5510  data: 0.5098  max mem: 700\n",
            "2021/05/23 23:10:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:10:56\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:10:57\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [  0/352]  eta: 0:05:31  lr: 0.010000000000000002  img/s: 294.6904605467191  loss: 0.0559 (0.0559)  time: 0.9426  data: 0.5082  max mem: 700\n",
            "2021/05/23 23:11:08\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1166.056157909369  loss: 0.0585 (0.0588)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:11:19\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1163.5340756890776  loss: 0.0566 (0.0585)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:11:30\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1167.8951991663967  loss: 0.0559 (0.0585)  time: 0.1107  data: 0.0004  max mem: 700\n",
            "2021/05/23 23:11:36\tINFO\ttorchdistill.misc.log\tEpoch: [117] Total time: 0:00:39\n",
            "2021/05/23 23:11:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6817  data: 0.6543  max mem: 700\n",
            "2021/05/23 23:11:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:11:37\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:11:38\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [  0/352]  eta: 0:05:27  lr: 0.010000000000000002  img/s: 310.19929289911937  loss: 0.0496 (0.0496)  time: 0.9299  data: 0.5173  max mem: 700\n",
            "2021/05/23 23:11:49\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1157.5158781664163  loss: 0.0558 (0.0573)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:12:00\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1167.8291470622144  loss: 0.0557 (0.0583)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:12:11\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1152.4792031598831  loss: 0.0554 (0.0580)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:12:17\tINFO\ttorchdistill.misc.log\tEpoch: [118] Total time: 0:00:39\n",
            "2021/05/23 23:12:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5633  data: 0.5139  max mem: 700\n",
            "2021/05/23 23:12:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:12:19\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:12:20\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [  0/352]  eta: 0:05:36  lr: 0.010000000000000002  img/s: 330.75396892383003  loss: 0.0668 (0.0668)  time: 0.9551  data: 0.5680  max mem: 700\n",
            "2021/05/23 23:12:31\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1170.6582818366965  loss: 0.0575 (0.0580)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:12:42\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1156.1150191117092  loss: 0.0569 (0.0575)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:12:53\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.755400965514  loss: 0.0546 (0.0578)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:12:59\tINFO\ttorchdistill.misc.log\tEpoch: [119] Total time: 0:00:39\n",
            "2021/05/23 23:12:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.6042  data: 0.5426  max mem: 700\n",
            "2021/05/23 23:13:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:13:00\tINFO\t__main__\t * Acc@1 87.0800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:13:01\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [  0/352]  eta: 0:06:19  lr: 0.010000000000000002  img/s: 350.2095643898006  loss: 0.0479 (0.0479)  time: 1.0772  data: 0.7117  max mem: 700\n",
            "2021/05/23 23:13:12\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1166.6440206526086  loss: 0.0593 (0.0582)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:13:23\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1162.4432160434083  loss: 0.0561 (0.0579)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:13:34\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1153.9853492451077  loss: 0.0573 (0.0580)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:13:40\tINFO\ttorchdistill.misc.log\tEpoch: [120] Total time: 0:00:40\n",
            "2021/05/23 23:13:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5634  data: 0.5479  max mem: 700\n",
            "2021/05/23 23:13:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:13:42\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:13:43\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [  0/352]  eta: 0:05:49  lr: 0.010000000000000002  img/s: 312.2911229827076  loss: 0.0637 (0.0637)  time: 0.9919  data: 0.5820  max mem: 700\n",
            "2021/05/23 23:13:54\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1150.0844283541483  loss: 0.0511 (0.0562)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:14:05\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.546145119552  loss: 0.0596 (0.0570)  time: 0.1109  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:14:16\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1151.628781768572  loss: 0.0570 (0.0572)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:14:22\tINFO\ttorchdistill.misc.log\tEpoch: [121] Total time: 0:00:40\n",
            "2021/05/23 23:14:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5795  data: 0.5300  max mem: 700\n",
            "2021/05/23 23:14:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:14:24\tINFO\t__main__\t * Acc@1 87.0400\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:14:25\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [  0/352]  eta: 0:05:53  lr: 0.010000000000000002  img/s: 319.96597651826687  loss: 0.0550 (0.0550)  time: 1.0031  data: 0.6030  max mem: 700\n",
            "2021/05/23 23:14:36\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1162.979572561813  loss: 0.0544 (0.0570)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:14:47\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1161.0128369260578  loss: 0.0592 (0.0567)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:14:58\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1157.518373823877  loss: 0.0521 (0.0564)  time: 0.1109  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:15:04\tINFO\ttorchdistill.misc.log\tEpoch: [122] Total time: 0:00:40\n",
            "2021/05/23 23:15:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5564  data: 0.5188  max mem: 700\n",
            "2021/05/23 23:15:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:15:06\tINFO\t__main__\t * Acc@1 86.9000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:15:07\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [  0/352]  eta: 0:05:25  lr: 0.010000000000000002  img/s: 313.0583192364905  loss: 0.0576 (0.0576)  time: 0.9238  data: 0.5149  max mem: 700\n",
            "2021/05/23 23:15:18\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1157.6906001815662  loss: 0.0558 (0.0560)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:15:29\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1155.4904632973617  loss: 0.0557 (0.0563)  time: 0.1109  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:15:40\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1169.6992736098584  loss: 0.0525 (0.0562)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:15:46\tINFO\ttorchdistill.misc.log\tEpoch: [123] Total time: 0:00:40\n",
            "2021/05/23 23:15:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5753  data: 0.5369  max mem: 700\n",
            "2021/05/23 23:15:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:15:47\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:15:48\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [  0/352]  eta: 0:05:40  lr: 0.010000000000000002  img/s: 312.5352775334397  loss: 0.0547 (0.0547)  time: 0.9680  data: 0.5584  max mem: 700\n",
            "2021/05/23 23:15:59\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1163.9301127137367  loss: 0.0582 (0.0565)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:16:10\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1165.6586730008055  loss: 0.0571 (0.0564)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:16:22\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1161.892266472755  loss: 0.0532 (0.0563)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:16:27\tINFO\ttorchdistill.misc.log\tEpoch: [124] Total time: 0:00:40\n",
            "2021/05/23 23:16:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5772  data: 0.5277  max mem: 700\n",
            "2021/05/23 23:16:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:16:29\tINFO\t__main__\t * Acc@1 87.0400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:16:30\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [  0/352]  eta: 0:05:58  lr: 0.010000000000000002  img/s: 311.7621304338484  loss: 0.0521 (0.0521)  time: 1.0194  data: 0.6088  max mem: 700\n",
            "2021/05/23 23:16:41\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1169.4928844189142  loss: 0.0555 (0.0552)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:16:52\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1152.4693073217643  loss: 0.0513 (0.0548)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:17:03\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1165.9776521510619  loss: 0.0553 (0.0548)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:17:09\tINFO\ttorchdistill.misc.log\tEpoch: [125] Total time: 0:00:40\n",
            "2021/05/23 23:17:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5379  data: 0.4834  max mem: 700\n",
            "2021/05/23 23:17:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:17:11\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:17:11\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [  0/352]  eta: 0:05:19  lr: 0.010000000000000002  img/s: 316.16833858051626  loss: 0.0652 (0.0652)  time: 0.9089  data: 0.5040  max mem: 700\n",
            "2021/05/23 23:17:23\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1146.8194531965933  loss: 0.0554 (0.0551)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:17:34\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1156.6081731753188  loss: 0.0534 (0.0555)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:17:45\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1166.6617671026584  loss: 0.0536 (0.0552)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:17:51\tINFO\ttorchdistill.misc.log\tEpoch: [126] Total time: 0:00:39\n",
            "2021/05/23 23:17:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5505  data: 0.4996  max mem: 700\n",
            "2021/05/23 23:17:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:17:52\tINFO\t__main__\t * Acc@1 87.1200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:17:53\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [  0/352]  eta: 0:06:04  lr: 0.010000000000000002  img/s: 350.902901364079  loss: 0.0539 (0.0539)  time: 1.0353  data: 0.6705  max mem: 700\n",
            "2021/05/23 23:18:04\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1164.518359130978  loss: 0.0534 (0.0548)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:18:15\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1163.7888201719873  loss: 0.0525 (0.0546)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:18:26\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1166.7936147785929  loss: 0.0544 (0.0547)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:18:32\tINFO\ttorchdistill.misc.log\tEpoch: [127] Total time: 0:00:39\n",
            "2021/05/23 23:18:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5589  data: 0.5200  max mem: 700\n",
            "2021/05/23 23:18:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:18:34\tINFO\t__main__\t * Acc@1 86.8800\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:18:35\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [  0/352]  eta: 0:06:28  lr: 0.010000000000000002  img/s: 284.84948001143914  loss: 0.0535 (0.0535)  time: 1.1047  data: 0.6554  max mem: 700\n",
            "2021/05/23 23:18:46\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1150.9572435556622  loss: 0.0562 (0.0544)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:18:57\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1148.2862722199764  loss: 0.0533 (0.0544)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:19:08\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1155.6745251338925  loss: 0.0521 (0.0546)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:19:14\tINFO\ttorchdistill.misc.log\tEpoch: [128] Total time: 0:00:40\n",
            "2021/05/23 23:19:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6545  data: 0.6278  max mem: 700\n",
            "2021/05/23 23:19:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:19:16\tINFO\t__main__\t * Acc@1 86.8800\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:19:17\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [  0/352]  eta: 0:05:29  lr: 0.010000000000000002  img/s: 315.4710916102707  loss: 0.0480 (0.0480)  time: 0.9359  data: 0.5301  max mem: 700\n",
            "2021/05/23 23:19:28\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1159.8164413806214  loss: 0.0526 (0.0542)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:19:39\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1171.4629176658498  loss: 0.0546 (0.0541)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:19:50\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1162.9115563151317  loss: 0.0558 (0.0541)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:19:56\tINFO\ttorchdistill.misc.log\tEpoch: [129] Total time: 0:00:39\n",
            "2021/05/23 23:19:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5467  data: 0.4988  max mem: 700\n",
            "2021/05/23 23:19:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:19:57\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:19:58\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [  0/352]  eta: 0:05:16  lr: 0.010000000000000002  img/s: 354.23111847162335  loss: 0.0538 (0.0538)  time: 0.8988  data: 0.5374  max mem: 700\n",
            "2021/05/23 23:20:09\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1158.8801101740464  loss: 0.0508 (0.0532)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:20:20\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1156.8399513881109  loss: 0.0540 (0.0533)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:20:31\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1161.1534561813305  loss: 0.0546 (0.0534)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:20:37\tINFO\ttorchdistill.misc.log\tEpoch: [130] Total time: 0:00:39\n",
            "2021/05/23 23:20:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5501  data: 0.5206  max mem: 700\n",
            "2021/05/23 23:20:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:20:39\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:20:40\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [  0/352]  eta: 0:05:32  lr: 0.010000000000000002  img/s: 298.92439959933387  loss: 0.0435 (0.0435)  time: 0.9457  data: 0.5175  max mem: 700\n",
            "2021/05/23 23:20:51\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1170.3494932715973  loss: 0.0567 (0.0534)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:21:02\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1159.3305620758088  loss: 0.0498 (0.0530)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:21:13\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1152.3159435594305  loss: 0.0498 (0.0530)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:21:19\tINFO\ttorchdistill.misc.log\tEpoch: [131] Total time: 0:00:39\n",
            "2021/05/23 23:21:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5667  data: 0.5279  max mem: 700\n",
            "2021/05/23 23:21:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:21:20\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:21:21\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [  0/352]  eta: 0:05:44  lr: 0.010000000000000002  img/s: 315.51985255744194  loss: 0.0449 (0.0449)  time: 0.9779  data: 0.5722  max mem: 700\n",
            "2021/05/23 23:21:32\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1165.0642176351105  loss: 0.0554 (0.0527)  time: 0.1106  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:21:44\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1166.0738864791956  loss: 0.0518 (0.0532)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:21:55\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1160.985219288666  loss: 0.0494 (0.0533)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:22:00\tINFO\ttorchdistill.misc.log\tEpoch: [132] Total time: 0:00:40\n",
            "2021/05/23 23:22:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5555  data: 0.5146  max mem: 700\n",
            "2021/05/23 23:22:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:22:02\tINFO\t__main__\t * Acc@1 87.0400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:22:03\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [  0/352]  eta: 0:05:21  lr: 0.010000000000000002  img/s: 326.4933131835887  loss: 0.0533 (0.0533)  time: 0.9142  data: 0.5221  max mem: 700\n",
            "2021/05/23 23:22:14\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1161.6559459927298  loss: 0.0537 (0.0522)  time: 0.1104  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:22:25\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1164.7331035126124  loss: 0.0537 (0.0529)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:22:36\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1173.4165165847774  loss: 0.0517 (0.0531)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:22:42\tINFO\ttorchdistill.misc.log\tEpoch: [133] Total time: 0:00:39\n",
            "2021/05/23 23:22:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5193  data: 0.4741  max mem: 700\n",
            "2021/05/23 23:22:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:22:43\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:22:44\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [  0/352]  eta: 0:05:34  lr: 0.010000000000000002  img/s: 301.40798221433744  loss: 0.0527 (0.0527)  time: 0.9515  data: 0.5268  max mem: 700\n",
            "2021/05/23 23:22:56\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1152.15520279159  loss: 0.0500 (0.0518)  time: 0.1110  data: 0.0004  max mem: 700\n",
            "2021/05/23 23:23:07\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1171.703245547221  loss: 0.0516 (0.0518)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:23:18\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1166.4767235198262  loss: 0.0523 (0.0521)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:23:23\tINFO\ttorchdistill.misc.log\tEpoch: [134] Total time: 0:00:39\n",
            "2021/05/23 23:23:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5422  data: 0.5018  max mem: 700\n",
            "2021/05/23 23:23:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:23:25\tINFO\t__main__\t * Acc@1 86.8600\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:23:26\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [  0/352]  eta: 0:05:28  lr: 0.010000000000000002  img/s: 302.6539675524289  loss: 0.0465 (0.0465)  time: 0.9336  data: 0.5106  max mem: 700\n",
            "2021/05/23 23:23:37\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [100/352]  eta: 0:00:30  lr: 0.010000000000000002  img/s: 1167.6157990087015  loss: 0.0551 (0.0517)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:23:48\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [200/352]  eta: 0:00:17  lr: 0.010000000000000002  img/s: 1162.6093581156435  loss: 0.0515 (0.0515)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:23:59\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [300/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 1160.3629156535364  loss: 0.0523 (0.0517)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:24:05\tINFO\ttorchdistill.misc.log\tEpoch: [135] Total time: 0:00:39\n",
            "2021/05/23 23:24:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5760  data: 0.5400  max mem: 700\n",
            "2021/05/23 23:24:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:24:07\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:24:08\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [  0/352]  eta: 0:05:19  lr: 0.0010000000000000002  img/s: 314.03856642313565  loss: 0.0524 (0.0524)  time: 0.9086  data: 0.5010  max mem: 700\n",
            "2021/05/23 23:24:19\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1167.740242565557  loss: 0.0518 (0.0523)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:24:30\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1162.9266703490703  loss: 0.0492 (0.0519)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:24:41\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1160.2275024906587  loss: 0.0492 (0.0520)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:24:47\tINFO\ttorchdistill.misc.log\tEpoch: [136] Total time: 0:00:39\n",
            "2021/05/23 23:24:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.6039  data: 0.5855  max mem: 700\n",
            "2021/05/23 23:24:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:24:48\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:24:49\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [  0/352]  eta: 0:05:19  lr: 0.0010000000000000002  img/s: 358.14649779256666  loss: 0.0531 (0.0531)  time: 0.9084  data: 0.5509  max mem: 700\n",
            "2021/05/23 23:25:00\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1155.0429899786147  loss: 0.0508 (0.0513)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:25:11\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1169.6635961969168  loss: 0.0532 (0.0515)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:25:22\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1158.8250789464028  loss: 0.0509 (0.0517)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:25:28\tINFO\ttorchdistill.misc.log\tEpoch: [137] Total time: 0:00:39\n",
            "2021/05/23 23:25:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6836  data: 0.6693  max mem: 700\n",
            "2021/05/23 23:25:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:25:30\tINFO\t__main__\t * Acc@1 86.9000\tAcc@5 99.3400\n",
            "\n",
            "2021/05/23 23:25:31\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [  0/352]  eta: 0:05:13  lr: 0.0010000000000000002  img/s: 337.8288878541134  loss: 0.0502 (0.0502)  time: 0.8913  data: 0.5124  max mem: 700\n",
            "2021/05/23 23:25:42\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1160.425617637523  loss: 0.0480 (0.0505)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:25:53\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.6072087302362  loss: 0.0532 (0.0508)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:26:04\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1161.7338708455864  loss: 0.0499 (0.0510)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:26:10\tINFO\ttorchdistill.misc.log\tEpoch: [138] Total time: 0:00:39\n",
            "2021/05/23 23:26:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 83.5938 (83.5938)  acc5: 99.2188 (99.2188)  time: 0.5220  data: 0.4874  max mem: 700\n",
            "2021/05/23 23:26:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:26:11\tINFO\t__main__\t * Acc@1 86.9200\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:26:12\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [  0/352]  eta: 0:05:50  lr: 0.0010000000000000002  img/s: 333.4649575739281  loss: 0.0553 (0.0553)  time: 0.9966  data: 0.6127  max mem: 700\n",
            "2021/05/23 23:26:24\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1164.7255229508269  loss: 0.0518 (0.0521)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:26:35\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1159.7838697273312  loss: 0.0491 (0.0516)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:26:46\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.4501627802565  loss: 0.0476 (0.0518)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:26:51\tINFO\ttorchdistill.misc.log\tEpoch: [139] Total time: 0:00:40\n",
            "2021/05/23 23:26:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5475  data: 0.5248  max mem: 700\n",
            "2021/05/23 23:26:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:26:53\tINFO\t__main__\t * Acc@1 87.1000\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:26:54\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [  0/352]  eta: 0:05:29  lr: 0.0010000000000000002  img/s: 302.6128543873632  loss: 0.0525 (0.0525)  time: 0.9374  data: 0.5144  max mem: 700\n",
            "2021/05/23 23:27:05\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1166.3652187514936  loss: 0.0501 (0.0512)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:27:16\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1159.2454498932245  loss: 0.0498 (0.0513)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:27:27\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1167.1182899018906  loss: 0.0478 (0.0513)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:27:33\tINFO\ttorchdistill.misc.log\tEpoch: [140] Total time: 0:00:39\n",
            "2021/05/23 23:27:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5036  data: 0.4844  max mem: 700\n",
            "2021/05/23 23:27:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:27:35\tINFO\t__main__\t * Acc@1 86.9800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:27:36\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [  0/352]  eta: 0:05:30  lr: 0.0010000000000000002  img/s: 308.4208285244691  loss: 0.0436 (0.0436)  time: 0.9381  data: 0.5231  max mem: 700\n",
            "2021/05/23 23:27:47\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1161.6031641283394  loss: 0.0497 (0.0504)  time: 0.1109  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:27:58\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1161.7238154384127  loss: 0.0495 (0.0509)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:28:09\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1150.4516383413227  loss: 0.0485 (0.0508)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:28:15\tINFO\ttorchdistill.misc.log\tEpoch: [141] Total time: 0:00:40\n",
            "2021/05/23 23:28:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5615  data: 0.5383  max mem: 700\n",
            "2021/05/23 23:28:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:28:16\tINFO\t__main__\t * Acc@1 86.8200\tAcc@5 99.4600\n",
            "\n",
            "2021/05/23 23:28:17\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [  0/352]  eta: 0:05:44  lr: 0.0010000000000000002  img/s: 330.6026370822136  loss: 0.0543 (0.0543)  time: 0.9779  data: 0.5907  max mem: 700\n",
            "2021/05/23 23:28:28\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.274104943296  loss: 0.0497 (0.0512)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:28:39\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1161.6107041010173  loss: 0.0518 (0.0509)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:28:50\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.477945514489  loss: 0.0492 (0.0509)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:28:56\tINFO\ttorchdistill.misc.log\tEpoch: [142] Total time: 0:00:39\n",
            "2021/05/23 23:28:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.6440  data: 0.6309  max mem: 700\n",
            "2021/05/23 23:28:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:28:58\tINFO\t__main__\t * Acc@1 86.9800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:28:59\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [  0/352]  eta: 0:05:29  lr: 0.0010000000000000002  img/s: 322.3427717816812  loss: 0.0466 (0.0466)  time: 0.9361  data: 0.5390  max mem: 700\n",
            "2021/05/23 23:29:10\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1170.2295945280248  loss: 0.0485 (0.0507)  time: 0.1107  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:29:21\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1160.5936923752063  loss: 0.0533 (0.0511)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:29:32\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1165.2336388556694  loss: 0.0483 (0.0510)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:29:38\tINFO\ttorchdistill.misc.log\tEpoch: [143] Total time: 0:00:39\n",
            "2021/05/23 23:29:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5471  data: 0.5247  max mem: 700\n",
            "2021/05/23 23:29:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:29:40\tINFO\t__main__\t * Acc@1 86.9600\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:29:40\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [  0/352]  eta: 0:05:33  lr: 0.0010000000000000002  img/s: 318.22417378150703  loss: 0.0491 (0.0491)  time: 0.9469  data: 0.5447  max mem: 700\n",
            "2021/05/23 23:29:52\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1156.1946922856596  loss: 0.0500 (0.0511)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:30:03\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1160.1573006999354  loss: 0.0489 (0.0507)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:30:14\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1159.8615436132866  loss: 0.0516 (0.0507)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:30:20\tINFO\ttorchdistill.misc.log\tEpoch: [144] Total time: 0:00:40\n",
            "2021/05/23 23:30:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5508  data: 0.5027  max mem: 700\n",
            "2021/05/23 23:30:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:30:21\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:30:22\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [  0/352]  eta: 0:05:48  lr: 0.0010000000000000002  img/s: 296.434756249403  loss: 0.0519 (0.0519)  time: 0.9900  data: 0.5581  max mem: 700\n",
            "2021/05/23 23:30:33\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1162.9770532996847  loss: 0.0503 (0.0513)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:30:44\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.7282767261242  loss: 0.0511 (0.0509)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:30:55\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1162.3752625174832  loss: 0.0540 (0.0511)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:31:01\tINFO\ttorchdistill.misc.log\tEpoch: [145] Total time: 0:00:40\n",
            "2021/05/23 23:31:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6142  data: 0.5618  max mem: 700\n",
            "2021/05/23 23:31:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:31:03\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:31:04\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [  0/352]  eta: 0:05:24  lr: 0.0010000000000000002  img/s: 323.4462185046083  loss: 0.0534 (0.0534)  time: 0.9206  data: 0.5248  max mem: 700\n",
            "2021/05/23 23:31:15\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.2791634018706  loss: 0.0484 (0.0502)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:31:26\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.743411997026  loss: 0.0538 (0.0508)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:31:37\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.8569333246544  loss: 0.0484 (0.0509)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:31:43\tINFO\ttorchdistill.misc.log\tEpoch: [146] Total time: 0:00:40\n",
            "2021/05/23 23:31:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5602  data: 0.5173  max mem: 700\n",
            "2021/05/23 23:31:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:31:45\tINFO\t__main__\t * Acc@1 86.8000\tAcc@5 99.4600\n",
            "\n",
            "2021/05/23 23:31:46\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [  0/352]  eta: 0:05:31  lr: 0.0010000000000000002  img/s: 321.4464809612423  loss: 0.0473 (0.0473)  time: 0.9423  data: 0.5441  max mem: 700\n",
            "2021/05/23 23:31:57\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1149.993278311738  loss: 0.0511 (0.0513)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:32:08\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1161.432284331605  loss: 0.0505 (0.0511)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:32:19\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1161.6634866506404  loss: 0.0496 (0.0507)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:32:25\tINFO\ttorchdistill.misc.log\tEpoch: [147] Total time: 0:00:40\n",
            "2021/05/23 23:32:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6569  data: 0.6413  max mem: 700\n",
            "2021/05/23 23:32:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:32:26\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:32:27\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [  0/352]  eta: 0:05:25  lr: 0.0010000000000000002  img/s: 330.27945899889573  loss: 0.0419 (0.0419)  time: 0.9246  data: 0.5370  max mem: 700\n",
            "2021/05/23 23:32:38\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1164.778588955591  loss: 0.0501 (0.0515)  time: 0.1111  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:32:49\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.2744015930075  loss: 0.0482 (0.0508)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:33:00\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1165.1072004444532  loss: 0.0502 (0.0510)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:33:06\tINFO\ttorchdistill.misc.log\tEpoch: [148] Total time: 0:00:40\n",
            "2021/05/23 23:33:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6717  data: 0.6414  max mem: 700\n",
            "2021/05/23 23:33:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:33:08\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:33:09\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [  0/352]  eta: 0:05:43  lr: 0.0010000000000000002  img/s: 290.40566064781984  loss: 0.0489 (0.0489)  time: 0.9770  data: 0.5363  max mem: 700\n",
            "2021/05/23 23:33:20\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1169.9159332050547  loss: 0.0527 (0.0518)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:33:31\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.3374186334759  loss: 0.0497 (0.0512)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:33:42\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1155.072810750569  loss: 0.0508 (0.0511)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:33:48\tINFO\ttorchdistill.misc.log\tEpoch: [149] Total time: 0:00:40\n",
            "2021/05/23 23:33:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5571  data: 0.5245  max mem: 700\n",
            "2021/05/23 23:33:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:33:50\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:33:51\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [  0/352]  eta: 0:05:20  lr: 0.0010000000000000002  img/s: 306.4176032153618  loss: 0.0544 (0.0544)  time: 0.9096  data: 0.4919  max mem: 700\n",
            "2021/05/23 23:34:02\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1156.7776362880272  loss: 0.0485 (0.0498)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:34:13\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1157.1341693141308  loss: 0.0503 (0.0506)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:34:24\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1160.142258564319  loss: 0.0496 (0.0506)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:34:30\tINFO\ttorchdistill.misc.log\tEpoch: [150] Total time: 0:00:39\n",
            "2021/05/23 23:34:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6004  data: 0.5728  max mem: 700\n",
            "2021/05/23 23:34:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:34:31\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:34:32\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [  0/352]  eta: 0:05:40  lr: 0.0010000000000000002  img/s: 290.5353152930837  loss: 0.0671 (0.0671)  time: 0.9677  data: 0.5271  max mem: 700\n",
            "2021/05/23 23:34:43\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1159.3480867236763  loss: 0.0504 (0.0502)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:34:54\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.597120867641  loss: 0.0492 (0.0506)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:35:05\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1162.735254942813  loss: 0.0496 (0.0508)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:35:11\tINFO\ttorchdistill.misc.log\tEpoch: [151] Total time: 0:00:40\n",
            "2021/05/23 23:35:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5561  data: 0.5060  max mem: 700\n",
            "2021/05/23 23:35:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:35:13\tINFO\t__main__\t * Acc@1 86.9800\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:35:14\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [  0/352]  eta: 0:05:28  lr: 0.0010000000000000002  img/s: 313.17062744850983  loss: 0.0409 (0.0409)  time: 0.9346  data: 0.5258  max mem: 700\n",
            "2021/05/23 23:35:25\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1153.4498203880992  loss: 0.0492 (0.0502)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:35:36\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.3727111584951  loss: 0.0481 (0.0504)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:35:47\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1155.9905517575496  loss: 0.0521 (0.0506)  time: 0.1108  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:35:53\tINFO\ttorchdistill.misc.log\tEpoch: [152] Total time: 0:00:39\n",
            "2021/05/23 23:35:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5642  data: 0.5088  max mem: 700\n",
            "2021/05/23 23:35:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:35:55\tINFO\t__main__\t * Acc@1 86.9600\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:35:56\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [  0/352]  eta: 0:05:32  lr: 0.0010000000000000002  img/s: 318.29039450820017  loss: 0.0500 (0.0500)  time: 0.9451  data: 0.5429  max mem: 700\n",
            "2021/05/23 23:36:07\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1162.0557358100957  loss: 0.0503 (0.0504)  time: 0.1109  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:36:18\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1165.5118999806787  loss: 0.0475 (0.0508)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:36:29\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1156.0975920685987  loss: 0.0485 (0.0507)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:36:35\tINFO\ttorchdistill.misc.log\tEpoch: [153] Total time: 0:00:40\n",
            "2021/05/23 23:36:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5434  data: 0.5128  max mem: 700\n",
            "2021/05/23 23:36:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:36:36\tINFO\t__main__\t * Acc@1 86.8600\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:36:37\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [  0/352]  eta: 0:06:10  lr: 0.0010000000000000002  img/s: 326.1902042854808  loss: 0.0611 (0.0611)  time: 1.0524  data: 0.6600  max mem: 700\n",
            "2021/05/23 23:36:48\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1169.9286803866705  loss: 0.0511 (0.0512)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:36:59\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1154.0101542919294  loss: 0.0501 (0.0509)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:37:10\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1152.212075167186  loss: 0.0527 (0.0512)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:37:16\tINFO\ttorchdistill.misc.log\tEpoch: [154] Total time: 0:00:40\n",
            "2021/05/23 23:37:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5986  data: 0.5423  max mem: 700\n",
            "2021/05/23 23:37:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:37:18\tINFO\t__main__\t * Acc@1 87.0800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:37:19\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [  0/352]  eta: 0:06:11  lr: 0.0010000000000000002  img/s: 360.16231460933454  loss: 0.0591 (0.0591)  time: 1.0555  data: 0.7000  max mem: 700\n",
            "2021/05/23 23:37:30\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1160.8597011310833  loss: 0.0504 (0.0509)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:37:41\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1158.8475910896218  loss: 0.0490 (0.0507)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:37:52\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1165.1729449936518  loss: 0.0486 (0.0506)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:37:58\tINFO\ttorchdistill.misc.log\tEpoch: [155] Total time: 0:00:40\n",
            "2021/05/23 23:37:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5352  data: 0.4897  max mem: 700\n",
            "2021/05/23 23:38:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:38:00\tINFO\t__main__\t * Acc@1 87.0600\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:38:01\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [  0/352]  eta: 0:05:47  lr: 0.0010000000000000002  img/s: 332.0766100000742  loss: 0.0532 (0.0532)  time: 0.9882  data: 0.6027  max mem: 700\n",
            "2021/05/23 23:38:12\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1159.8715668080308  loss: 0.0505 (0.0503)  time: 0.1112  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:38:23\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1164.220374635145  loss: 0.0505 (0.0500)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:38:34\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1167.196949339734  loss: 0.0489 (0.0503)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:38:40\tINFO\ttorchdistill.misc.log\tEpoch: [156] Total time: 0:00:40\n",
            "2021/05/23 23:38:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6202  data: 0.5905  max mem: 700\n",
            "2021/05/23 23:38:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:38:41\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:38:42\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [  0/352]  eta: 0:05:25  lr: 0.0010000000000000002  img/s: 325.36625352792123  loss: 0.0425 (0.0425)  time: 0.9254  data: 0.5320  max mem: 700\n",
            "2021/05/23 23:38:53\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1160.761815807453  loss: 0.0478 (0.0495)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:39:04\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.9376829252428  loss: 0.0523 (0.0502)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:39:15\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1155.5998984032958  loss: 0.0494 (0.0507)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:39:21\tINFO\ttorchdistill.misc.log\tEpoch: [157] Total time: 0:00:40\n",
            "2021/05/23 23:39:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5442  data: 0.5006  max mem: 700\n",
            "2021/05/23 23:39:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:39:23\tINFO\t__main__\t * Acc@1 87.1400\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:39:24\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [  0/352]  eta: 0:05:36  lr: 0.0010000000000000002  img/s: 283.6023688868862  loss: 0.0530 (0.0530)  time: 0.9546  data: 0.5032  max mem: 700\n",
            "2021/05/23 23:39:35\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.1274287462861  loss: 0.0503 (0.0509)  time: 0.1109  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:39:46\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1148.3648699811126  loss: 0.0501 (0.0508)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:39:57\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1165.9143487551903  loss: 0.0501 (0.0507)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:40:03\tINFO\ttorchdistill.misc.log\tEpoch: [158] Total time: 0:00:40\n",
            "2021/05/23 23:40:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5582  data: 0.5160  max mem: 700\n",
            "2021/05/23 23:40:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:40:05\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.4600\n",
            "\n",
            "2021/05/23 23:40:06\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [  0/352]  eta: 0:06:01  lr: 0.0010000000000000002  img/s: 338.1874664172171  loss: 0.0517 (0.0517)  time: 1.0257  data: 0.6472  max mem: 700\n",
            "2021/05/23 23:40:17\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1167.1538122061033  loss: 0.0483 (0.0498)  time: 0.1104  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:40:28\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1158.4600040998198  loss: 0.0513 (0.0498)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:40:39\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1163.5466841782454  loss: 0.0507 (0.0503)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:40:45\tINFO\ttorchdistill.misc.log\tEpoch: [159] Total time: 0:00:40\n",
            "2021/05/23 23:40:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5658  data: 0.5263  max mem: 700\n",
            "2021/05/23 23:40:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:40:46\tINFO\t__main__\t * Acc@1 87.0400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:40:47\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [  0/352]  eta: 0:05:33  lr: 0.0010000000000000002  img/s: 301.83229381359257  loss: 0.0474 (0.0474)  time: 0.9472  data: 0.5231  max mem: 700\n",
            "2021/05/23 23:40:58\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1161.485050667636  loss: 0.0480 (0.0501)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:41:09\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1162.5715943836672  loss: 0.0492 (0.0496)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:41:20\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1158.8726056079608  loss: 0.0483 (0.0495)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:41:26\tINFO\ttorchdistill.misc.log\tEpoch: [160] Total time: 0:00:40\n",
            "2021/05/23 23:41:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5361  data: 0.4960  max mem: 700\n",
            "2021/05/23 23:41:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:41:28\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:41:29\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [  0/352]  eta: 0:05:27  lr: 0.0010000000000000002  img/s: 308.61691546864427  loss: 0.0607 (0.0607)  time: 0.9312  data: 0.5164  max mem: 700\n",
            "2021/05/23 23:41:40\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1157.4784445958417  loss: 0.0461 (0.0501)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:41:51\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1169.686531426816  loss: 0.0505 (0.0502)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:42:02\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.9656219960204  loss: 0.0478 (0.0499)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:42:08\tINFO\ttorchdistill.misc.log\tEpoch: [161] Total time: 0:00:40\n",
            "2021/05/23 23:42:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6590  data: 0.6204  max mem: 700\n",
            "2021/05/23 23:42:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:42:10\tINFO\t__main__\t * Acc@1 86.9600\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:42:10\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [  0/352]  eta: 0:05:45  lr: 0.0010000000000000002  img/s: 326.3170923687261  loss: 0.0428 (0.0428)  time: 0.9805  data: 0.5882  max mem: 700\n",
            "2021/05/23 23:42:22\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1160.5987102799293  loss: 0.0488 (0.0510)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:42:33\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1160.490834889673  loss: 0.0486 (0.0511)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:42:44\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1169.1006909587406  loss: 0.0502 (0.0510)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:42:50\tINFO\ttorchdistill.misc.log\tEpoch: [162] Total time: 0:00:40\n",
            "2021/05/23 23:42:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5489  data: 0.5238  max mem: 700\n",
            "2021/05/23 23:42:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:42:51\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:42:52\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [  0/352]  eta: 0:06:20  lr: 0.0010000000000000002  img/s: 387.3552656546832  loss: 0.0522 (0.0522)  time: 1.0813  data: 0.7508  max mem: 700\n",
            "2021/05/23 23:43:03\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1160.287682216531  loss: 0.0501 (0.0500)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:43:14\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1164.8089145579713  loss: 0.0483 (0.0502)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:43:25\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1170.140324187189  loss: 0.0476 (0.0501)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:43:31\tINFO\ttorchdistill.misc.log\tEpoch: [163] Total time: 0:00:40\n",
            "2021/05/23 23:43:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5603  data: 0.5315  max mem: 700\n",
            "2021/05/23 23:43:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:43:33\tINFO\t__main__\t * Acc@1 86.9400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:43:34\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [  0/352]  eta: 0:05:49  lr: 0.0010000000000000002  img/s: 327.95683367979683  loss: 0.0527 (0.0527)  time: 0.9936  data: 0.6032  max mem: 700\n",
            "2021/05/23 23:43:45\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1154.9585061526548  loss: 0.0485 (0.0511)  time: 0.1107  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:43:56\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1157.9627723592316  loss: 0.0477 (0.0506)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:44:07\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1161.9375302998822  loss: 0.0497 (0.0505)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:44:13\tINFO\ttorchdistill.misc.log\tEpoch: [164] Total time: 0:00:39\n",
            "2021/05/23 23:44:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5726  data: 0.5410  max mem: 700\n",
            "2021/05/23 23:44:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:44:14\tINFO\t__main__\t * Acc@1 87.1600\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:44:15\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [  0/352]  eta: 0:05:31  lr: 0.0010000000000000002  img/s: 307.3256763935447  loss: 0.0488 (0.0488)  time: 0.9423  data: 0.5257  max mem: 700\n",
            "2021/05/23 23:44:27\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1153.8737397292366  loss: 0.0489 (0.0506)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:44:38\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1158.6800216684255  loss: 0.0515 (0.0506)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:44:49\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.275919500347  loss: 0.0501 (0.0506)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:44:54\tINFO\ttorchdistill.misc.log\tEpoch: [165] Total time: 0:00:39\n",
            "2021/05/23 23:44:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.6808  data: 0.6518  max mem: 700\n",
            "2021/05/23 23:44:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:44:56\tINFO\t__main__\t * Acc@1 86.9000\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:44:57\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [  0/352]  eta: 0:05:23  lr: 0.0010000000000000002  img/s: 358.77620013432283  loss: 0.0544 (0.0544)  time: 0.9196  data: 0.5628  max mem: 700\n",
            "2021/05/23 23:45:08\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1166.6085293721399  loss: 0.0497 (0.0498)  time: 0.1107  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:45:19\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1154.5611010752689  loss: 0.0519 (0.0503)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:45:30\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.3971266960475  loss: 0.0521 (0.0504)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:45:36\tINFO\ttorchdistill.misc.log\tEpoch: [166] Total time: 0:00:39\n",
            "2021/05/23 23:45:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5988  data: 0.5787  max mem: 700\n",
            "2021/05/23 23:45:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:45:38\tINFO\t__main__\t * Acc@1 86.8600\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:45:39\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [  0/352]  eta: 0:05:48  lr: 0.0010000000000000002  img/s: 362.74792011680995  loss: 0.0472 (0.0472)  time: 0.9903  data: 0.6374  max mem: 700\n",
            "2021/05/23 23:45:50\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1153.839021171697  loss: 0.0508 (0.0510)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:46:01\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1165.4157583861731  loss: 0.0502 (0.0509)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:46:12\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1163.0299600965309  loss: 0.0492 (0.0505)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:46:18\tINFO\ttorchdistill.misc.log\tEpoch: [167] Total time: 0:00:39\n",
            "2021/05/23 23:46:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5214  data: 0.4874  max mem: 700\n",
            "2021/05/23 23:46:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:46:19\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:46:20\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [  0/352]  eta: 0:05:34  lr: 0.0010000000000000002  img/s: 320.2467339803833  loss: 0.0615 (0.0615)  time: 0.9503  data: 0.5506  max mem: 700\n",
            "2021/05/23 23:46:31\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1166.2233344194635  loss: 0.0477 (0.0496)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:46:42\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1162.823398946493  loss: 0.0512 (0.0500)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:46:53\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1156.5384086772008  loss: 0.0507 (0.0503)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:46:59\tINFO\ttorchdistill.misc.log\tEpoch: [168] Total time: 0:00:39\n",
            "2021/05/23 23:47:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5439  data: 0.5146  max mem: 700\n",
            "2021/05/23 23:47:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:47:01\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:47:02\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [  0/352]  eta: 0:05:39  lr: 0.0010000000000000002  img/s: 299.9655889706807  loss: 0.0464 (0.0464)  time: 0.9632  data: 0.5365  max mem: 700\n",
            "2021/05/23 23:47:13\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1141.4916355533633  loss: 0.0501 (0.0505)  time: 0.1108  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:47:24\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1167.4355298865771  loss: 0.0500 (0.0504)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:47:35\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1171.250795202171  loss: 0.0518 (0.0507)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:47:41\tINFO\ttorchdistill.misc.log\tEpoch: [169] Total time: 0:00:39\n",
            "2021/05/23 23:47:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5497  data: 0.5165  max mem: 700\n",
            "2021/05/23 23:47:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:47:42\tINFO\t__main__\t * Acc@1 86.9800\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:47:43\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [  0/352]  eta: 0:05:20  lr: 0.0010000000000000002  img/s: 348.0786315210739  loss: 0.0424 (0.0424)  time: 0.9101  data: 0.5423  max mem: 700\n",
            "2021/05/23 23:47:54\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1158.350026646299  loss: 0.0486 (0.0494)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:48:05\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1168.8385265174607  loss: 0.0472 (0.0503)  time: 0.1103  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:48:16\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1157.383623718919  loss: 0.0495 (0.0500)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:48:22\tINFO\ttorchdistill.misc.log\tEpoch: [170] Total time: 0:00:39\n",
            "2021/05/23 23:48:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5407  data: 0.5009  max mem: 700\n",
            "2021/05/23 23:48:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:48:24\tINFO\t__main__\t * Acc@1 86.9200\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:48:25\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [  0/352]  eta: 0:05:20  lr: 0.0010000000000000002  img/s: 377.36483435534524  loss: 0.0402 (0.0402)  time: 0.9101  data: 0.5709  max mem: 700\n",
            "2021/05/23 23:48:36\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.0111256019045  loss: 0.0484 (0.0495)  time: 0.1104  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:48:47\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1161.7967210844313  loss: 0.0476 (0.0501)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:48:58\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1161.9853126102473  loss: 0.0506 (0.0507)  time: 0.1106  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:49:04\tINFO\ttorchdistill.misc.log\tEpoch: [171] Total time: 0:00:39\n",
            "2021/05/23 23:49:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5719  data: 0.5310  max mem: 700\n",
            "2021/05/23 23:49:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:49:05\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:49:06\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [  0/352]  eta: 0:05:25  lr: 0.0010000000000000002  img/s: 323.8483349770929  loss: 0.0498 (0.0498)  time: 0.9246  data: 0.5293  max mem: 700\n",
            "2021/05/23 23:49:17\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1162.4104966873078  loss: 0.0516 (0.0504)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:49:28\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1161.4951019419157  loss: 0.0455 (0.0501)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:49:40\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1154.9609907946622  loss: 0.0486 (0.0502)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:49:45\tINFO\ttorchdistill.misc.log\tEpoch: [172] Total time: 0:00:39\n",
            "2021/05/23 23:49:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5801  data: 0.5626  max mem: 700\n",
            "2021/05/23 23:49:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:49:47\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:49:48\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [  0/352]  eta: 0:05:14  lr: 0.0010000000000000002  img/s: 325.20247479831994  loss: 0.0580 (0.0580)  time: 0.8923  data: 0.4987  max mem: 700\n",
            "2021/05/23 23:49:59\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.762448646348  loss: 0.0487 (0.0504)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:50:10\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1163.3777531225892  loss: 0.0506 (0.0508)  time: 0.1106  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:50:21\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1162.002917609984  loss: 0.0493 (0.0506)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:50:27\tINFO\ttorchdistill.misc.log\tEpoch: [173] Total time: 0:00:40\n",
            "2021/05/23 23:50:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5465  data: 0.5072  max mem: 700\n",
            "2021/05/23 23:50:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:50:29\tINFO\t__main__\t * Acc@1 86.8800\tAcc@5 99.3800\n",
            "\n",
            "2021/05/23 23:50:29\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [  0/352]  eta: 0:05:17  lr: 0.0010000000000000002  img/s: 315.7187604382783  loss: 0.0517 (0.0517)  time: 0.9023  data: 0.4968  max mem: 700\n",
            "2021/05/23 23:50:41\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1163.0224016879795  loss: 0.0503 (0.0500)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:50:52\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1155.9905517575496  loss: 0.0508 (0.0497)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:51:03\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1164.917594268182  loss: 0.0499 (0.0498)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:51:09\tINFO\ttorchdistill.misc.log\tEpoch: [174] Total time: 0:00:40\n",
            "2021/05/23 23:51:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5568  data: 0.5362  max mem: 700\n",
            "2021/05/23 23:51:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:51:10\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4800\n",
            "\n",
            "2021/05/23 23:51:11\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [  0/352]  eta: 0:05:15  lr: 0.0010000000000000002  img/s: 343.8473744751384  loss: 0.0537 (0.0537)  time: 0.8950  data: 0.5227  max mem: 700\n",
            "2021/05/23 23:51:22\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1151.6436039452742  loss: 0.0505 (0.0507)  time: 0.1108  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:51:33\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1157.002002073191  loss: 0.0501 (0.0506)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:51:44\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1157.503400040533  loss: 0.0494 (0.0505)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:51:50\tINFO\ttorchdistill.misc.log\tEpoch: [175] Total time: 0:00:39\n",
            "2021/05/23 23:51:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5213  data: 0.4990  max mem: 700\n",
            "2021/05/23 23:51:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:51:52\tINFO\t__main__\t * Acc@1 87.0400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:51:53\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [  0/352]  eta: 0:05:19  lr: 0.0010000000000000002  img/s: 353.9746751649806  loss: 0.0436 (0.0436)  time: 0.9078  data: 0.5462  max mem: 700\n",
            "2021/05/23 23:52:04\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1165.3297504031882  loss: 0.0498 (0.0503)  time: 0.1104  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:52:15\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1170.0077191131954  loss: 0.0510 (0.0502)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:52:26\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1152.5682733510232  loss: 0.0484 (0.0501)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:52:32\tINFO\ttorchdistill.misc.log\tEpoch: [176] Total time: 0:00:39\n",
            "2021/05/23 23:52:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5324  data: 0.4985  max mem: 700\n",
            "2021/05/23 23:52:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:52:33\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/23 23:52:34\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [  0/352]  eta: 0:05:14  lr: 0.0010000000000000002  img/s: 347.1250629598331  loss: 0.0545 (0.0545)  time: 0.8922  data: 0.5234  max mem: 700\n",
            "2021/05/23 23:52:45\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1157.44101344636  loss: 0.0505 (0.0504)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:52:56\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1159.66612593503  loss: 0.0481 (0.0501)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:53:07\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1167.984127260386  loss: 0.0505 (0.0502)  time: 0.1103  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:53:13\tINFO\ttorchdistill.misc.log\tEpoch: [177] Total time: 0:00:39\n",
            "2021/05/23 23:53:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5125  data: 0.4772  max mem: 700\n",
            "2021/05/23 23:53:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:53:15\tINFO\t__main__\t * Acc@1 87.0200\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:53:16\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [  0/352]  eta: 0:05:52  lr: 0.0010000000000000002  img/s: 290.6320422811602  loss: 0.0439 (0.0439)  time: 1.0020  data: 0.5615  max mem: 700\n",
            "2021/05/23 23:53:27\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1157.9652699441153  loss: 0.0474 (0.0495)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:53:38\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1146.7239212436295  loss: 0.0458 (0.0493)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:53:49\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1160.410568543367  loss: 0.0469 (0.0492)  time: 0.1107  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:53:55\tINFO\ttorchdistill.misc.log\tEpoch: [178] Total time: 0:00:40\n",
            "2021/05/23 23:53:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5707  data: 0.5394  max mem: 700\n",
            "2021/05/23 23:53:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:53:56\tINFO\t__main__\t * Acc@1 86.9600\tAcc@5 99.4400\n",
            "\n",
            "2021/05/23 23:53:57\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [  0/352]  eta: 0:05:42  lr: 0.0010000000000000002  img/s: 368.2646326071448  loss: 0.0505 (0.0505)  time: 0.9720  data: 0.6244  max mem: 700\n",
            "2021/05/23 23:54:09\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1166.5907845416716  loss: 0.0489 (0.0501)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:54:20\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1168.3018381784907  loss: 0.0492 (0.0504)  time: 0.1101  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:54:31\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1166.1878687299616  loss: 0.0480 (0.0505)  time: 0.1101  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:54:36\tINFO\ttorchdistill.misc.log\tEpoch: [179] Total time: 0:00:39\n",
            "2021/05/23 23:54:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5531  data: 0.4995  max mem: 700\n",
            "2021/05/23 23:54:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:54:38\tINFO\t__main__\t * Acc@1 87.0000\tAcc@5 99.4800\n",
            "\n",
            "2021/05/23 23:54:39\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [  0/352]  eta: 0:05:44  lr: 0.0010000000000000002  img/s: 281.1716900439194  loss: 0.0692 (0.0692)  time: 0.9786  data: 0.5233  max mem: 700\n",
            "2021/05/23 23:54:50\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1154.6331104520498  loss: 0.0483 (0.0502)  time: 0.1107  data: 0.0003  max mem: 700\n",
            "2021/05/23 23:55:01\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1171.033640958079  loss: 0.0469 (0.0498)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:55:12\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1159.4632618770975  loss: 0.0476 (0.0499)  time: 0.1105  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:55:18\tINFO\ttorchdistill.misc.log\tEpoch: [180] Total time: 0:00:39\n",
            "2021/05/23 23:55:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.6168  data: 0.6001  max mem: 700\n",
            "2021/05/23 23:55:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:55:20\tINFO\t__main__\t * Acc@1 86.8200\tAcc@5 99.4200\n",
            "\n",
            "2021/05/23 23:55:21\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [  0/352]  eta: 0:05:44  lr: 0.0010000000000000002  img/s: 302.01805118327286  loss: 0.0406 (0.0406)  time: 0.9779  data: 0.5541  max mem: 700\n",
            "2021/05/23 23:55:32\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [100/352]  eta: 0:00:30  lr: 0.0010000000000000002  img/s: 1166.0207023868993  loss: 0.0490 (0.0496)  time: 0.1106  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:55:43\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [200/352]  eta: 0:00:17  lr: 0.0010000000000000002  img/s: 1153.2615117587923  loss: 0.0501 (0.0498)  time: 0.1105  data: 0.0005  max mem: 700\n",
            "2021/05/23 23:55:54\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [300/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 1156.1025711701623  loss: 0.0517 (0.0499)  time: 0.1105  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:56:00\tINFO\ttorchdistill.misc.log\tEpoch: [181] Total time: 0:00:39\n",
            "2021/05/23 23:56:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6926  data: 0.6482  max mem: 700\n",
            "2021/05/23 23:56:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/23 23:56:01\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.4000\n",
            "\n",
            "2021/05/23 23:56:01\tINFO\t__main__\tTraining time 2:06:09\n",
            "2021/05/23 23:56:01\tINFO\ttorchdistill.common.main_util\tLoading model parameters\n",
            "2021/05/23 23:56:01\tINFO\t__main__\t[Teacher: densenet_bc_k12_depth100]\n",
            "2021/05/23 23:56:02\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:29:46  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.5387  data: 0.3895  max mem: 700\n",
            "2021/05/23 23:56:16\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:02:10  acc1: 100.0000 (95.1049)  acc5: 100.0000 (99.8002)  time: 0.0138  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:56:30\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:01:54  acc1: 100.0000 (95.3023)  acc5: 100.0000 (99.8001)  time: 0.0139  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:56:44\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:01:38  acc1: 100.0000 (95.3682)  acc5: 100.0000 (99.7667)  time: 0.0142  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:56:58\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:01:24  acc1: 100.0000 (95.4511)  acc5: 100.0000 (99.8000)  time: 0.0141  data: 0.0002  max mem: 700\n",
            "2021/05/23 23:57:12\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:01:10  acc1: 100.0000 (95.4009)  acc5: 100.0000 (99.8000)  time: 0.0137  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:57:26\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:56  acc1: 100.0000 (95.4674)  acc5: 100.0000 (99.8334)  time: 0.0143  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:57:40\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:42  acc1: 100.0000 (95.4864)  acc5: 100.0000 (99.8572)  time: 0.0142  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:57:53\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:28  acc1: 100.0000 (95.4256)  acc5: 100.0000 (99.8500)  time: 0.0139  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:07\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:14  acc1: 100.0000 (95.4561)  acc5: 100.0000 (99.8445)  time: 0.0137  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:22\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:02:20\n",
            "2021/05/23 23:58:22\tINFO\t__main__\t * Acc@1 95.5300\tAcc@5 99.8600\n",
            "\n",
            "2021/05/23 23:58:22\tINFO\t__main__\t[Student: resnet20]\n",
            "2021/05/23 23:58:22\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:09:27  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.4167  data: 0.3809  max mem: 700\n",
            "2021/05/23 23:58:27\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:00:45  acc1: 100.0000 (87.5125)  acc5: 100.0000 (99.3007)  time: 0.0048  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:31\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:00:39  acc1: 100.0000 (86.5567)  acc5: 100.0000 (99.0505)  time: 0.0047  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:36\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:00:34  acc1: 100.0000 (86.1380)  acc5: 100.0000 (99.0337)  time: 0.0050  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:41\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:00:29  acc1: 100.0000 (86.1785)  acc5: 100.0000 (99.1002)  time: 0.0048  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:46\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:00:24  acc1: 100.0000 (86.4027)  acc5: 100.0000 (99.2202)  time: 0.0048  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:51\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:19  acc1: 100.0000 (86.4023)  acc5: 100.0000 (99.2168)  time: 0.0047  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:58:56\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:14  acc1: 100.0000 (86.2734)  acc5: 100.0000 (99.1858)  time: 0.0052  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:59:00\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:09  acc1: 100.0000 (86.1517)  acc5: 100.0000 (99.2376)  time: 0.0049  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:59:05\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:04  acc1: 100.0000 (86.0904)  acc5: 100.0000 (99.2667)  time: 0.0050  data: 0.0001  max mem: 700\n",
            "2021/05/23 23:59:10\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:00:48\n",
            "2021/05/23 23:59:10\tINFO\t__main__\t * Acc@1 86.2000\tAcc@5 99.2900\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7t8BdOEI8kHJ"
      },
      "source": [
        "### 4.2 Final run with hyperparameters determinded by the above hyperparameter-tuning\n",
        "Once you tune the hyperparameters, you can update the values in **a config file whose name ends with \"-final_run.yaml\"**. Notice that the only difference between default example configs for hyperparameter tuning and final run is datasets entry."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KlkskjjK8kxC",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "b6d6ccd2-0317-45ea-908a-fd1ccbc2a433"
      },
      "source": [
        "!python torchdistill/examples/image_classification.py --config torchdistill/configs/sample/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-final_run.yaml --log log/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-final_run.log"
      ],
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "2021/05/24 23:17:35\tINFO\ttorchdistill.common.main_util\tNot using distributed mode\n",
            "2021/05/24 23:17:35\tINFO\t__main__\tNamespace(adjust_lr=False, config='torchdistill/configs/sample/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-final_run.yaml', device='cuda', dist_url='env://', log='log/cifar10/kd/resnet20_from_densenet_bc_k12_depth100-final_run.log', seed=None, start_epoch=0, student_only=False, sync_bn=False, test_only=False, world_size=1)\n",
            "2021/05/24 23:17:35\tINFO\ttorchdistill.datasets.util\tLoading train data\n",
            "Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to ./resource/dataset/cifar10/cifar-10-python.tar.gz\n",
            "170499072it [00:02, 61951596.94it/s]                   \n",
            "Extracting ./resource/dataset/cifar10/cifar-10-python.tar.gz to ./resource/dataset/cifar10\n",
            "2021/05/24 23:17:40\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/train`: 5.456872463226318 sec\n",
            "2021/05/24 23:17:40\tINFO\ttorchdistill.datasets.util\tLoading val data\n",
            "Files already downloaded and verified\n",
            "2021/05/24 23:17:41\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/val`: 0.7256088256835938 sec\n",
            "2021/05/24 23:17:41\tINFO\ttorchdistill.datasets.util\tLoading test data\n",
            "Files already downloaded and verified\n",
            "2021/05/24 23:17:42\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/test`: 0.7504622936248779 sec\n",
            "Downloading: \"https://github.com/yoshitomo-matsubara/torchdistill/releases/download/v0.1.1/cifar10-densenet_bc_k12_depth100.pt\" to /root/.cache/torch/hub/checkpoints/cifar10-densenet_bc_k12_depth100.pt\n",
            "100% 3.23M/3.23M [00:00<00:00, 40.4MB/s]\n",
            "2021/05/24 23:17:42\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/teacher/cifar10-densenet_bc_k12_depth100.pt`\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/kd/cifar10-resnet20_from_densenet_bc_k12_depth100-final_run.pt`\n",
            "2021/05/24 23:17:53\tINFO\t__main__\tStart training\n",
            "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py:477: UserWarning: This DataLoader will create 16 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.\n",
            "  cpuset_checked))\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.models.util\t[teacher model]\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.models.util\tUsing the original teacher model\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.models.util\t[student model]\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.models.util\tUsing the original student model\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.core.distillation\tLoss = 1.0 * OrgLoss\n",
            "2021/05/24 23:17:53\tINFO\ttorchdistill.core.distillation\tFreezing the whole teacher model\n",
            "2021/05/24 23:17:55\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [  0/391]  eta: 0:13:16  lr: 0.1  img/s: 159.68050034546275  loss: 4.6544 (4.6544)  time: 2.0379  data: 1.2363  max mem: 700\n",
            "2021/05/24 23:18:06\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1215.379749213888  loss: 3.7150 (3.9337)  time: 0.1056  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:18:16\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1214.2197655562668  loss: 3.2760 (3.7053)  time: 0.1058  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:18:27\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1207.6238325745442  loss: 3.0600 (3.5455)  time: 0.1063  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:18:37\tINFO\ttorchdistill.misc.log\tEpoch: [0] Total time: 0:00:43\n",
            "2021/05/24 23:18:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:53  acc1: 42.9688 (42.9688)  acc5: 90.6250 (90.6250)  time: 0.6808  data: 0.6370  max mem: 700\n",
            "2021/05/24 23:18:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:18:39\tINFO\t__main__\t * Acc@1 43.5200\tAcc@5 91.2700\n",
            "\n",
            "2021/05/24 23:18:39\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 0.0000 -> 43.5200)\n",
            "2021/05/24 23:18:40\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [  0/391]  eta: 0:06:54  lr: 0.1  img/s: 253.89249394673124  loss: 2.8865 (2.8865)  time: 1.0591  data: 0.5549  max mem: 700\n",
            "2021/05/24 23:18:51\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [100/391]  eta: 0:00:34  lr: 0.1  img/s: 1199.6123493699963  loss: 2.5650 (2.6698)  time: 0.1070  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:19:02\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [200/391]  eta: 0:00:21  lr: 0.1  img/s: 1193.025261773124  loss: 2.3272 (2.5692)  time: 0.1075  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:19:13\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1193.6618701197062  loss: 2.2058 (2.4721)  time: 0.1077  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:19:23\tINFO\ttorchdistill.misc.log\tEpoch: [1] Total time: 0:00:43\n",
            "2021/05/24 23:19:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 53.1250 (53.1250)  acc5: 97.6562 (97.6562)  time: 0.5381  data: 0.5070  max mem: 700\n",
            "2021/05/24 23:19:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:19:25\tINFO\t__main__\t * Acc@1 57.9800\tAcc@5 96.4700\n",
            "\n",
            "2021/05/24 23:19:25\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 43.5200 -> 57.9800)\n",
            "2021/05/24 23:19:26\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [  0/391]  eta: 0:05:46  lr: 0.1  img/s: 330.9747991788372  loss: 2.2020 (2.2020)  time: 0.8871  data: 0.5003  max mem: 700\n",
            "2021/05/24 23:19:37\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [100/391]  eta: 0:00:34  lr: 0.1  img/s: 1184.7610422225018  loss: 2.0021 (2.0346)  time: 0.1089  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:19:48\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [200/391]  eta: 0:00:21  lr: 0.1  img/s: 1178.7391966838068  loss: 1.8329 (1.9781)  time: 0.1088  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:19:59\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1173.86550869897  loss: 1.8186 (1.9258)  time: 0.1091  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:20:09\tINFO\ttorchdistill.misc.log\tEpoch: [2] Total time: 0:00:43\n",
            "2021/05/24 23:20:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 66.4062 (66.4062)  acc5: 98.4375 (98.4375)  time: 0.5882  data: 0.5075  max mem: 700\n",
            "2021/05/24 23:20:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:20:12\tINFO\t__main__\t * Acc@1 66.0000\tAcc@5 97.3200\n",
            "\n",
            "2021/05/24 23:20:12\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 57.9800 -> 66.0000)\n",
            "2021/05/24 23:20:13\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [  0/391]  eta: 0:08:20  lr: 0.1  img/s: 319.6862819822695  loss: 1.7498 (1.7498)  time: 1.2802  data: 0.8798  max mem: 700\n",
            "2021/05/24 23:20:24\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1164.4451115164634  loss: 1.5723 (1.6734)  time: 0.1102  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:20:35\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1165.9447335273421  loss: 1.5870 (1.6425)  time: 0.1100  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:20:46\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1169.2712882500273  loss: 1.5233 (1.6212)  time: 0.1102  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:20:56\tINFO\ttorchdistill.misc.log\tEpoch: [3] Total time: 0:00:44\n",
            "2021/05/24 23:20:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.5856  data: 0.5271  max mem: 700\n",
            "2021/05/24 23:20:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:20:59\tINFO\t__main__\t * Acc@1 73.7300\tAcc@5 98.4900\n",
            "\n",
            "2021/05/24 23:20:59\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 66.0000 -> 73.7300)\n",
            "2021/05/24 23:21:00\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [  0/391]  eta: 0:06:15  lr: 0.1  img/s: 278.4187158958785  loss: 1.7142 (1.7142)  time: 0.9594  data: 0.4996  max mem: 700\n",
            "2021/05/24 23:21:11\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1160.6087462195483  loss: 1.3640 (1.4634)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:21:22\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1151.0830973081336  loss: 1.3931 (1.4540)  time: 0.1106  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:21:33\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1156.737758147051  loss: 1.3239 (1.4281)  time: 0.1111  data: 0.0005  max mem: 700\n",
            "2021/05/24 23:21:43\tINFO\ttorchdistill.misc.log\tEpoch: [4] Total time: 0:00:44\n",
            "2021/05/24 23:21:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 78.1250 (78.1250)  acc5: 98.4375 (98.4375)  time: 0.6258  data: 0.5956  max mem: 700\n",
            "2021/05/24 23:21:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:21:46\tINFO\t__main__\t * Acc@1 75.3400\tAcc@5 98.2800\n",
            "\n",
            "2021/05/24 23:21:46\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 73.7300 -> 75.3400)\n",
            "2021/05/24 23:21:47\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [  0/391]  eta: 0:06:46  lr: 0.1  img/s: 334.78707348815396  loss: 1.1943 (1.1943)  time: 1.0389  data: 0.6565  max mem: 700\n",
            "2021/05/24 23:21:58\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1155.4705682321999  loss: 1.3455 (1.3491)  time: 0.1109  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:22:09\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1155.6919394245983  loss: 1.2364 (1.3176)  time: 0.1109  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:22:20\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1155.0802661841558  loss: 1.2646 (1.3013)  time: 0.1113  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:22:31\tINFO\ttorchdistill.misc.log\tEpoch: [5] Total time: 0:00:44\n",
            "2021/05/24 23:22:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 82.8125 (82.8125)  acc5: 99.2188 (99.2188)  time: 0.5961  data: 0.5446  max mem: 700\n",
            "2021/05/24 23:22:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:22:33\tINFO\t__main__\t * Acc@1 76.3900\tAcc@5 98.6400\n",
            "\n",
            "2021/05/24 23:22:33\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 75.3400 -> 76.3900)\n",
            "2021/05/24 23:22:34\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [  0/391]  eta: 0:07:00  lr: 0.1  img/s: 333.9883517662092  loss: 1.1772 (1.1772)  time: 1.0753  data: 0.6920  max mem: 700\n",
            "2021/05/24 23:22:46\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1150.4688955843087  loss: 1.2283 (1.1771)  time: 0.1116  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:22:57\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1155.500411086862  loss: 1.2361 (1.1850)  time: 0.1114  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:23:08\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1151.9722601894666  loss: 1.1566 (1.1908)  time: 0.1115  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:23:18\tINFO\ttorchdistill.misc.log\tEpoch: [6] Total time: 0:00:45\n",
            "2021/05/24 23:23:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5316  data: 0.4958  max mem: 700\n",
            "2021/05/24 23:23:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:23:21\tINFO\t__main__\t * Acc@1 73.2700\tAcc@5 98.8000\n",
            "\n",
            "2021/05/24 23:23:22\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [  0/391]  eta: 0:07:41  lr: 0.1  img/s: 350.16068347972526  loss: 1.3833 (1.3833)  time: 1.1805  data: 0.8149  max mem: 700\n",
            "2021/05/24 23:23:33\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.5843262464361  loss: 1.1213 (1.1426)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:23:44\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1150.888159079411  loss: 1.0571 (1.1316)  time: 0.1117  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:23:56\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1149.9883516940167  loss: 1.1136 (1.1289)  time: 0.1115  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:24:06\tINFO\ttorchdistill.misc.log\tEpoch: [7] Total time: 0:00:45\n",
            "2021/05/24 23:24:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 75.7812 (75.7812)  acc5: 98.4375 (98.4375)  time: 0.5360  data: 0.4884  max mem: 700\n",
            "2021/05/24 23:24:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:24:08\tINFO\t__main__\t * Acc@1 74.1900\tAcc@5 98.5300\n",
            "\n",
            "2021/05/24 23:24:09\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [  0/391]  eta: 0:07:20  lr: 0.1  img/s: 330.2311078688329  loss: 1.1500 (1.1500)  time: 1.1272  data: 0.7396  max mem: 700\n",
            "2021/05/24 23:24:21\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.9602451231679  loss: 1.0287 (1.0520)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:24:32\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1147.2434151199018  loss: 1.0425 (1.0715)  time: 0.1118  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:24:43\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1151.453414976783  loss: 1.0342 (1.0659)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:24:53\tINFO\ttorchdistill.misc.log\tEpoch: [8] Total time: 0:00:45\n",
            "2021/05/24 23:24:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5680  data: 0.5176  max mem: 700\n",
            "2021/05/24 23:24:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:24:56\tINFO\t__main__\t * Acc@1 79.0200\tAcc@5 98.8300\n",
            "\n",
            "2021/05/24 23:24:56\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 76.3900 -> 79.0200)\n",
            "2021/05/24 23:24:57\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [  0/391]  eta: 0:06:02  lr: 0.1  img/s: 309.8280139173351  loss: 1.3538 (1.3538)  time: 0.9282  data: 0.5150  max mem: 700\n",
            "2021/05/24 23:25:08\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.2684177629685  loss: 0.9765 (0.9791)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:25:20\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1144.5871928911934  loss: 1.0258 (0.9914)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:25:31\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1143.6972073870354  loss: 0.9783 (1.0005)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:25:41\tINFO\ttorchdistill.misc.log\tEpoch: [9] Total time: 0:00:45\n",
            "2021/05/24 23:25:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.6170  data: 0.5255  max mem: 700\n",
            "2021/05/24 23:25:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:25:44\tINFO\t__main__\t * Acc@1 79.3300\tAcc@5 99.1300\n",
            "\n",
            "2021/05/24 23:25:44\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 79.0200 -> 79.3300)\n",
            "2021/05/24 23:25:45\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [  0/391]  eta: 0:06:27  lr: 0.1  img/s: 347.4346183739386  loss: 0.9245 (0.9245)  time: 0.9919  data: 0.6235  max mem: 700\n",
            "2021/05/24 23:25:56\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1147.8885361009015  loss: 0.9882 (0.9230)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:26:07\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1135.6146527398796  loss: 0.9847 (0.9531)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:26:18\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1147.0473244082846  loss: 0.9282 (0.9544)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:26:29\tINFO\ttorchdistill.misc.log\tEpoch: [10] Total time: 0:00:45\n",
            "2021/05/24 23:26:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 81.2500 (81.2500)  acc5: 99.2188 (99.2188)  time: 0.5671  data: 0.5295  max mem: 700\n",
            "2021/05/24 23:26:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:26:31\tINFO\t__main__\t * Acc@1 81.9600\tAcc@5 99.2500\n",
            "\n",
            "2021/05/24 23:26:31\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 79.3300 -> 81.9600)\n",
            "2021/05/24 23:26:32\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [  0/391]  eta: 0:05:59  lr: 0.1  img/s: 326.18326793922904  loss: 0.7193 (0.7193)  time: 0.9203  data: 0.5278  max mem: 700\n",
            "2021/05/24 23:26:44\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1143.8531595622057  loss: 0.8672 (0.9103)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:26:55\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1152.303577292659  loss: 0.9363 (0.9180)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:27:06\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.8483553508406  loss: 0.9267 (0.9249)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:27:16\tINFO\ttorchdistill.misc.log\tEpoch: [11] Total time: 0:00:45\n",
            "2021/05/24 23:27:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 79.6875 (79.6875)  acc5: 100.0000 (100.0000)  time: 0.5145  data: 0.4883  max mem: 700\n",
            "2021/05/24 23:27:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:27:19\tINFO\t__main__\t * Acc@1 78.8500\tAcc@5 98.7100\n",
            "\n",
            "2021/05/24 23:27:20\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [  0/391]  eta: 0:07:17  lr: 0.1  img/s: 337.27157203830114  loss: 0.7424 (0.7424)  time: 1.1194  data: 0.7398  max mem: 700\n",
            "2021/05/24 23:27:31\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.7337186601562  loss: 0.8686 (0.8760)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:27:43\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1147.3660058643004  loss: 0.8576 (0.8722)  time: 0.1117  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:27:54\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.5540399459173  loss: 0.9651 (0.8877)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:28:04\tINFO\ttorchdistill.misc.log\tEpoch: [12] Total time: 0:00:45\n",
            "2021/05/24 23:28:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 83.5938 (83.5938)  acc5: 98.4375 (98.4375)  time: 0.5476  data: 0.5092  max mem: 700\n",
            "2021/05/24 23:28:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:28:07\tINFO\t__main__\t * Acc@1 82.3200\tAcc@5 98.9900\n",
            "\n",
            "2021/05/24 23:28:07\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 81.9600 -> 82.3200)\n",
            "2021/05/24 23:28:08\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [  0/391]  eta: 0:07:11  lr: 0.1  img/s: 361.201841294019  loss: 0.8746 (0.8746)  time: 1.1046  data: 0.7502  max mem: 700\n",
            "2021/05/24 23:28:19\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1152.4519900139744  loss: 0.8063 (0.8388)  time: 0.1117  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:28:30\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1145.029042103265  loss: 0.8252 (0.8397)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:28:42\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1154.9585061526548  loss: 0.8297 (0.8476)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:28:52\tINFO\ttorchdistill.misc.log\tEpoch: [13] Total time: 0:00:45\n",
            "2021/05/24 23:28:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 89.0625 (89.0625)  acc5: 100.0000 (100.0000)  time: 0.5944  data: 0.5538  max mem: 700\n",
            "2021/05/24 23:28:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:28:54\tINFO\t__main__\t * Acc@1 84.6500\tAcc@5 99.2300\n",
            "\n",
            "2021/05/24 23:28:54\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 82.3200 -> 84.6500)\n",
            "2021/05/24 23:28:56\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [  0/391]  eta: 0:07:01  lr: 0.1  img/s: 292.45858945501374  loss: 0.9605 (0.9605)  time: 1.0775  data: 0.6397  max mem: 700\n",
            "2021/05/24 23:29:07\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.0534636064847  loss: 0.7139 (0.7868)  time: 0.1133  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:29:18\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.0214196001223  loss: 0.9285 (0.8140)  time: 0.1128  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:29:30\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.4372161333865  loss: 0.8615 (0.8270)  time: 0.1129  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:29:40\tINFO\ttorchdistill.misc.log\tEpoch: [14] Total time: 0:00:45\n",
            "2021/05/24 23:29:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 98.4375 (98.4375)  time: 0.5629  data: 0.5146  max mem: 700\n",
            "2021/05/24 23:29:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:29:43\tINFO\t__main__\t * Acc@1 84.3200\tAcc@5 99.3200\n",
            "\n",
            "2021/05/24 23:29:44\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [  0/391]  eta: 0:06:01  lr: 0.1  img/s: 318.37136838909237  loss: 0.5850 (0.5850)  time: 0.9247  data: 0.5226  max mem: 700\n",
            "2021/05/24 23:29:55\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1144.4578761684484  loss: 0.7419 (0.7866)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:30:06\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.9310975596786  loss: 0.7767 (0.7965)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:30:18\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.756243420563  loss: 0.8395 (0.7961)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:30:28\tINFO\ttorchdistill.misc.log\tEpoch: [15] Total time: 0:00:45\n",
            "2021/05/24 23:30:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5660  data: 0.5365  max mem: 700\n",
            "2021/05/24 23:30:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:30:31\tINFO\t__main__\t * Acc@1 83.0600\tAcc@5 99.2600\n",
            "\n",
            "2021/05/24 23:30:32\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [  0/391]  eta: 0:06:52  lr: 0.1  img/s: 311.7505442429289  loss: 0.9248 (0.9248)  time: 1.0556  data: 0.6449  max mem: 700\n",
            "2021/05/24 23:30:43\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1149.8479608315165  loss: 0.7597 (0.7596)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:30:54\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.2679599865887  loss: 0.7877 (0.7833)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:31:06\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.072539279679  loss: 0.7644 (0.7828)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:31:16\tINFO\ttorchdistill.misc.log\tEpoch: [16] Total time: 0:00:45\n",
            "2021/05/24 23:31:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.5702  data: 0.5183  max mem: 700\n",
            "2021/05/24 23:31:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:31:19\tINFO\t__main__\t * Acc@1 83.3800\tAcc@5 99.2600\n",
            "\n",
            "2021/05/24 23:31:20\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [  0/391]  eta: 0:07:22  lr: 0.1  img/s: 348.09149551294894  loss: 0.9303 (0.9303)  time: 1.1325  data: 0.7647  max mem: 700\n",
            "2021/05/24 23:31:31\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.1011459922183  loss: 0.6899 (0.7425)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:31:42\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1147.974443408572  loss: 0.6906 (0.7556)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:31:54\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.3993272639295  loss: 0.7259 (0.7483)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:32:04\tINFO\ttorchdistill.misc.log\tEpoch: [17] Total time: 0:00:45\n",
            "2021/05/24 23:32:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:58  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.7459  data: 0.7272  max mem: 700\n",
            "2021/05/24 23:32:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:32:06\tINFO\t__main__\t * Acc@1 81.0500\tAcc@5 99.2200\n",
            "\n",
            "2021/05/24 23:32:07\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [  0/391]  eta: 0:05:53  lr: 0.1  img/s: 360.68084431703744  loss: 0.7740 (0.7740)  time: 0.9048  data: 0.5499  max mem: 700\n",
            "2021/05/24 23:32:19\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.5280422020417  loss: 0.6864 (0.7254)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:32:30\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1147.358649680821  loss: 0.7114 (0.7358)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:32:42\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1134.7649436074332  loss: 0.7430 (0.7434)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:32:52\tINFO\ttorchdistill.misc.log\tEpoch: [18] Total time: 0:00:45\n",
            "2021/05/24 23:32:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5889  data: 0.5372  max mem: 700\n",
            "2021/05/24 23:32:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:32:54\tINFO\t__main__\t * Acc@1 84.8200\tAcc@5 99.4300\n",
            "\n",
            "2021/05/24 23:32:54\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.6500 -> 84.8200)\n",
            "2021/05/24 23:32:56\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [  0/391]  eta: 0:07:35  lr: 0.1  img/s: 315.61760523263433  loss: 0.6982 (0.6982)  time: 1.1660  data: 0.7604  max mem: 700\n",
            "2021/05/24 23:33:07\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1140.3908253996576  loss: 0.6596 (0.7069)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:33:18\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1143.6752800228364  loss: 0.7059 (0.7212)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:33:29\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.258289725536  loss: 0.6857 (0.7162)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:33:40\tINFO\ttorchdistill.misc.log\tEpoch: [19] Total time: 0:00:45\n",
            "2021/05/24 23:33:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.6000  data: 0.5331  max mem: 700\n",
            "2021/05/24 23:33:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:33:42\tINFO\t__main__\t * Acc@1 82.9400\tAcc@5 99.2000\n",
            "\n",
            "2021/05/24 23:33:44\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [  0/391]  eta: 0:07:51  lr: 0.1  img/s: 305.8638641204926  loss: 0.8040 (0.8040)  time: 1.2069  data: 0.7884  max mem: 700\n",
            "2021/05/24 23:33:55\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.260718018738  loss: 0.6672 (0.6740)  time: 0.1130  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:34:06\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.8063881824141  loss: 0.6711 (0.6865)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:34:18\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.0481596000623  loss: 0.7566 (0.7043)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:34:28\tINFO\ttorchdistill.misc.log\tEpoch: [20] Total time: 0:00:45\n",
            "2021/05/24 23:34:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5879  data: 0.5648  max mem: 700\n",
            "2021/05/24 23:34:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:34:30\tINFO\t__main__\t * Acc@1 82.7800\tAcc@5 99.2500\n",
            "\n",
            "2021/05/24 23:34:32\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [  0/391]  eta: 0:08:05  lr: 0.1  img/s: 333.02188734206345  loss: 0.7228 (0.7228)  time: 1.2419  data: 0.8575  max mem: 700\n",
            "2021/05/24 23:34:43\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1147.5891882648427  loss: 0.6658 (0.6922)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:34:54\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1144.8532380267964  loss: 0.6394 (0.6780)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:35:05\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1123.3606645533202  loss: 0.6899 (0.6943)  time: 0.1126  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:35:16\tINFO\ttorchdistill.misc.log\tEpoch: [21] Total time: 0:00:45\n",
            "2021/05/24 23:35:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5373  data: 0.5060  max mem: 700\n",
            "2021/05/24 23:35:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:35:18\tINFO\t__main__\t * Acc@1 86.6700\tAcc@5 99.3500\n",
            "\n",
            "2021/05/24 23:35:18\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.8200 -> 86.6700)\n",
            "2021/05/24 23:35:20\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [  0/391]  eta: 0:07:58  lr: 0.1  img/s: 335.8297753090127  loss: 0.6027 (0.6027)  time: 1.2236  data: 0.8425  max mem: 700\n",
            "2021/05/24 23:35:31\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.65184218025  loss: 0.6479 (0.6681)  time: 0.1131  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:35:42\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.354999724112  loss: 0.7154 (0.6750)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:35:54\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1137.2721191181797  loss: 0.6507 (0.6759)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:36:04\tINFO\ttorchdistill.misc.log\tEpoch: [22] Total time: 0:00:45\n",
            "2021/05/24 23:36:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.6510  data: 0.6154  max mem: 700\n",
            "2021/05/24 23:36:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:36:06\tINFO\t__main__\t * Acc@1 85.4700\tAcc@5 99.3600\n",
            "\n",
            "2021/05/24 23:36:08\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [  0/391]  eta: 0:07:57  lr: 0.1  img/s: 368.89318627194996  loss: 0.5863 (0.5863)  time: 1.2207  data: 0.8737  max mem: 700\n",
            "2021/05/24 23:36:19\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.515226000273  loss: 0.6263 (0.6414)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:36:30\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.270806480629  loss: 0.6380 (0.6552)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:36:41\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.0900978146342  loss: 0.6531 (0.6631)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:36:52\tINFO\ttorchdistill.misc.log\tEpoch: [23] Total time: 0:00:45\n",
            "2021/05/24 23:36:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5614  data: 0.5008  max mem: 700\n",
            "2021/05/24 23:36:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:36:54\tINFO\t__main__\t * Acc@1 84.9500\tAcc@5 99.4300\n",
            "\n",
            "2021/05/24 23:36:56\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [  0/391]  eta: 0:08:31  lr: 0.1  img/s: 292.35363800966576  loss: 0.6805 (0.6805)  time: 1.3086  data: 0.8707  max mem: 700\n",
            "2021/05/24 23:37:07\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.6711291249637  loss: 0.6161 (0.6591)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:37:18\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1143.2369092388087  loss: 0.6835 (0.6510)  time: 0.1123  data: 0.0005  max mem: 700\n",
            "2021/05/24 23:37:29\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1134.7457558336152  loss: 0.6223 (0.6525)  time: 0.1130  data: 0.0003  max mem: 700\n",
            "2021/05/24 23:37:40\tINFO\ttorchdistill.misc.log\tEpoch: [24] Total time: 0:00:45\n",
            "2021/05/24 23:37:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5767  data: 0.5243  max mem: 700\n",
            "2021/05/24 23:37:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:37:43\tINFO\t__main__\t * Acc@1 83.5900\tAcc@5 99.0300\n",
            "\n",
            "2021/05/24 23:37:44\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [  0/391]  eta: 0:06:39  lr: 0.1  img/s: 311.6662082465692  loss: 0.6792 (0.6792)  time: 1.0212  data: 0.6105  max mem: 700\n",
            "2021/05/24 23:37:55\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1140.5022645581776  loss: 0.6341 (0.6413)  time: 0.1126  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:38:06\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.5025140880196  loss: 0.6561 (0.6500)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:38:18\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1138.8957734049504  loss: 0.6407 (0.6474)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:38:28\tINFO\ttorchdistill.misc.log\tEpoch: [25] Total time: 0:00:45\n",
            "2021/05/24 23:38:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 90.6250 (90.6250)  acc5: 99.2188 (99.2188)  time: 0.5975  data: 0.5191  max mem: 700\n",
            "2021/05/24 23:38:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:38:31\tINFO\t__main__\t * Acc@1 84.7900\tAcc@5 99.3900\n",
            "\n",
            "2021/05/24 23:38:32\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [  0/391]  eta: 0:07:30  lr: 0.1  img/s: 294.07754777855075  loss: 0.5586 (0.5586)  time: 1.1531  data: 0.7178  max mem: 700\n",
            "2021/05/24 23:38:43\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1150.727816370842  loss: 0.6723 (0.6154)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:38:54\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.4367675946623  loss: 0.6744 (0.6111)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:39:06\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1134.6162553310198  loss: 0.6261 (0.6226)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:39:16\tINFO\ttorchdistill.misc.log\tEpoch: [26] Total time: 0:00:45\n",
            "2021/05/24 23:39:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5165  data: 0.4820  max mem: 700\n",
            "2021/05/24 23:39:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:39:19\tINFO\t__main__\t * Acc@1 86.8400\tAcc@5 99.5000\n",
            "\n",
            "2021/05/24 23:39:19\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.6700 -> 86.8400)\n",
            "2021/05/24 23:39:20\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [  0/391]  eta: 0:08:20  lr: 0.1  img/s: 327.62720850644183  loss: 0.6381 (0.6381)  time: 1.2795  data: 0.8887  max mem: 700\n",
            "2021/05/24 23:39:31\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1143.5607841132503  loss: 0.6548 (0.6107)  time: 0.1124  data: 0.0003  max mem: 700\n",
            "2021/05/24 23:39:43\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1135.026441692759  loss: 0.6007 (0.6046)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:39:54\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1132.7370342160398  loss: 0.6306 (0.6197)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:40:04\tINFO\ttorchdistill.misc.log\tEpoch: [27] Total time: 0:00:45\n",
            "2021/05/24 23:40:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5615  data: 0.5272  max mem: 700\n",
            "2021/05/24 23:40:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:40:07\tINFO\t__main__\t * Acc@1 85.4200\tAcc@5 99.3000\n",
            "\n",
            "2021/05/24 23:40:08\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [  0/391]  eta: 0:07:27  lr: 0.1  img/s: 319.07828509754137  loss: 0.7349 (0.7349)  time: 1.1457  data: 0.7445  max mem: 700\n",
            "2021/05/24 23:40:19\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1133.8949511589842  loss: 0.5568 (0.5710)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:40:31\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1134.1871964474715  loss: 0.6774 (0.5960)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:40:42\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1143.1103313474912  loss: 0.6408 (0.6111)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:40:52\tINFO\ttorchdistill.misc.log\tEpoch: [28] Total time: 0:00:45\n",
            "2021/05/24 23:40:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5828  data: 0.5400  max mem: 700\n",
            "2021/05/24 23:40:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:40:55\tINFO\t__main__\t * Acc@1 84.2600\tAcc@5 99.4100\n",
            "\n",
            "2021/05/24 23:40:55\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [  0/391]  eta: 0:05:31  lr: 0.1  img/s: 360.0499979545316  loss: 0.4066 (0.4066)  time: 0.8490  data: 0.4934  max mem: 700\n",
            "2021/05/24 23:41:07\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.287963051849  loss: 0.6043 (0.6010)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:41:18\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1148.0088099321292  loss: 0.5656 (0.6100)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:41:30\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1136.5185633660892  loss: 0.6026 (0.6093)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:41:40\tINFO\ttorchdistill.misc.log\tEpoch: [29] Total time: 0:00:45\n",
            "2021/05/24 23:41:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.6511  data: 0.6237  max mem: 700\n",
            "2021/05/24 23:41:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:41:43\tINFO\t__main__\t * Acc@1 86.3400\tAcc@5 99.5300\n",
            "\n",
            "2021/05/24 23:41:44\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [  0/391]  eta: 0:06:42  lr: 0.1  img/s: 316.77257517782175  loss: 0.5726 (0.5726)  time: 1.0304  data: 0.6263  max mem: 700\n",
            "2021/05/24 23:41:55\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1134.6810018873628  loss: 0.5933 (0.5918)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:42:06\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1140.8221674458139  loss: 0.5530 (0.5934)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:42:18\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.5823328635229  loss: 0.5521 (0.5946)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:42:28\tINFO\ttorchdistill.misc.log\tEpoch: [30] Total time: 0:00:45\n",
            "2021/05/24 23:42:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5754  data: 0.5240  max mem: 700\n",
            "2021/05/24 23:42:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:42:30\tINFO\t__main__\t * Acc@1 84.0900\tAcc@5 99.2800\n",
            "\n",
            "2021/05/24 23:42:32\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [  0/391]  eta: 0:07:45  lr: 0.1  img/s: 320.85095071213766  loss: 0.6056 (0.6056)  time: 1.1899  data: 0.7909  max mem: 700\n",
            "2021/05/24 23:42:43\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.8499611507882  loss: 0.5377 (0.5747)  time: 0.1127  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:42:54\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1143.117633156253  loss: 0.5204 (0.5827)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:43:06\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.3529802961966  loss: 0.6082 (0.5915)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:43:16\tINFO\ttorchdistill.misc.log\tEpoch: [31] Total time: 0:00:45\n",
            "2021/05/24 23:43:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5711  data: 0.5148  max mem: 700\n",
            "2021/05/24 23:43:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:43:19\tINFO\t__main__\t * Acc@1 83.4300\tAcc@5 99.1700\n",
            "\n",
            "2021/05/24 23:43:20\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [  0/391]  eta: 0:08:07  lr: 0.1  img/s: 301.80836912899196  loss: 0.4851 (0.4851)  time: 1.2474  data: 0.8233  max mem: 700\n",
            "2021/05/24 23:43:31\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.0170256062404  loss: 0.5786 (0.5706)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:43:42\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.2924508334816  loss: 0.5463 (0.5737)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:43:54\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1136.309285900239  loss: 0.6372 (0.5855)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:44:04\tINFO\ttorchdistill.misc.log\tEpoch: [32] Total time: 0:00:45\n",
            "2021/05/24 23:44:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:59  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.7571  data: 0.7264  max mem: 700\n",
            "2021/05/24 23:44:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:44:06\tINFO\t__main__\t * Acc@1 86.9700\tAcc@5 99.3900\n",
            "\n",
            "2021/05/24 23:44:06\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.8400 -> 86.9700)\n",
            "2021/05/24 23:44:07\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [  0/391]  eta: 0:05:44  lr: 0.1  img/s: 350.15748613871267  loss: 0.4375 (0.4375)  time: 0.8804  data: 0.5148  max mem: 700\n",
            "2021/05/24 23:44:19\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1136.030369139943  loss: 0.5675 (0.5632)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:44:30\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.476931421404  loss: 0.5869 (0.5718)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:44:42\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.2824656859832  loss: 0.5726 (0.5800)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:44:52\tINFO\ttorchdistill.misc.log\tEpoch: [33] Total time: 0:00:45\n",
            "2021/05/24 23:44:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5487  data: 0.5129  max mem: 700\n",
            "2021/05/24 23:44:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:44:54\tINFO\t__main__\t * Acc@1 85.7100\tAcc@5 99.3900\n",
            "\n",
            "2021/05/24 23:44:56\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [  0/391]  eta: 0:07:56  lr: 0.1  img/s: 306.605196865593  loss: 0.5264 (0.5264)  time: 1.2190  data: 0.8015  max mem: 700\n",
            "2021/05/24 23:45:07\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1144.6555229583134  loss: 0.5762 (0.5644)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:45:18\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.4728525130133  loss: 0.5254 (0.5675)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:45:30\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1146.0531964854456  loss: 0.6373 (0.5699)  time: 0.1123  data: 0.0005  max mem: 700\n",
            "2021/05/24 23:45:40\tINFO\ttorchdistill.misc.log\tEpoch: [34] Total time: 0:00:45\n",
            "2021/05/24 23:45:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:52  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.6703  data: 0.6434  max mem: 700\n",
            "2021/05/24 23:45:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:45:42\tINFO\t__main__\t * Acc@1 84.1800\tAcc@5 99.2900\n",
            "\n",
            "2021/05/24 23:45:43\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [  0/391]  eta: 0:07:36  lr: 0.1  img/s: 326.4601580276822  loss: 0.7045 (0.7045)  time: 1.1672  data: 0.7751  max mem: 700\n",
            "2021/05/24 23:45:55\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1143.855596652406  loss: 0.4859 (0.5524)  time: 0.1129  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:46:06\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1146.0874480721034  loss: 0.5879 (0.5603)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:46:17\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.7081305990744  loss: 0.5654 (0.5682)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:46:28\tINFO\ttorchdistill.misc.log\tEpoch: [35] Total time: 0:00:45\n",
            "2021/05/24 23:46:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.6229  data: 0.5696  max mem: 700\n",
            "2021/05/24 23:46:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:46:30\tINFO\t__main__\t * Acc@1 85.5100\tAcc@5 99.4200\n",
            "\n",
            "2021/05/24 23:46:31\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [  0/391]  eta: 0:06:12  lr: 0.1  img/s: 306.5710559315491  loss: 0.5934 (0.5934)  time: 0.9527  data: 0.5352  max mem: 700\n",
            "2021/05/24 23:46:43\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.1205833235829  loss: 0.5530 (0.5402)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:46:54\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1145.7352437780366  loss: 0.5803 (0.5521)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:47:05\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1143.7020802488203  loss: 0.5674 (0.5640)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:47:16\tINFO\ttorchdistill.misc.log\tEpoch: [36] Total time: 0:00:45\n",
            "2021/05/24 23:47:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5320  data: 0.4989  max mem: 700\n",
            "2021/05/24 23:47:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:47:18\tINFO\t__main__\t * Acc@1 85.3700\tAcc@5 99.5000\n",
            "\n",
            "2021/05/24 23:47:19\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [  0/391]  eta: 0:06:14  lr: 0.1  img/s: 339.1267704210352  loss: 0.5836 (0.5836)  time: 0.9583  data: 0.5808  max mem: 700\n",
            "2021/05/24 23:47:31\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1133.258282479245  loss: 0.5592 (0.5376)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:47:42\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1145.965130376872  loss: 0.5421 (0.5546)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:47:53\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1138.7146017464488  loss: 0.5120 (0.5610)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:48:04\tINFO\ttorchdistill.misc.log\tEpoch: [37] Total time: 0:00:45\n",
            "2021/05/24 23:48:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:01:03  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.8036  data: 0.7678  max mem: 700\n",
            "2021/05/24 23:48:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:48:06\tINFO\t__main__\t * Acc@1 85.8900\tAcc@5 99.4500\n",
            "\n",
            "2021/05/24 23:48:07\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [  0/391]  eta: 0:06:06  lr: 0.1  img/s: 351.0913011093098  loss: 0.5295 (0.5295)  time: 0.9380  data: 0.5734  max mem: 700\n",
            "2021/05/24 23:48:19\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1148.1291089701779  loss: 0.5522 (0.5199)  time: 0.1133  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:48:30\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.725067030674  loss: 0.5703 (0.5330)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:48:41\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1149.739612378199  loss: 0.5216 (0.5461)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:48:51\tINFO\ttorchdistill.misc.log\tEpoch: [38] Total time: 0:00:45\n",
            "2021/05/24 23:48:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5723  data: 0.5207  max mem: 700\n",
            "2021/05/24 23:48:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:48:54\tINFO\t__main__\t * Acc@1 85.5900\tAcc@5 99.3600\n",
            "\n",
            "2021/05/24 23:48:55\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [  0/391]  eta: 0:08:22  lr: 0.1  img/s: 350.0264454124101  loss: 0.5079 (0.5079)  time: 1.2841  data: 0.9184  max mem: 700\n",
            "2021/05/24 23:49:07\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1152.3579908518982  loss: 0.5300 (0.5280)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:49:18\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.1733536675774  loss: 0.5420 (0.5358)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:49:29\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.8145221835382  loss: 0.5411 (0.5472)  time: 0.1126  data: 0.0006  max mem: 700\n",
            "2021/05/24 23:49:39\tINFO\ttorchdistill.misc.log\tEpoch: [39] Total time: 0:00:45\n",
            "2021/05/24 23:49:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 87.5000 (87.5000)  acc5: 98.4375 (98.4375)  time: 0.5827  data: 0.5476  max mem: 700\n",
            "2021/05/24 23:49:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:49:42\tINFO\t__main__\t * Acc@1 86.5600\tAcc@5 99.3800\n",
            "\n",
            "2021/05/24 23:49:43\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [  0/391]  eta: 0:07:28  lr: 0.1  img/s: 320.13444824948107  loss: 0.5388 (0.5388)  time: 1.1477  data: 0.7478  max mem: 700\n",
            "2021/05/24 23:49:54\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1137.7710262746311  loss: 0.5168 (0.5374)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:50:06\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1149.6165139186296  loss: 0.5662 (0.5446)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:50:17\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.8678863045568  loss: 0.5450 (0.5493)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:50:27\tINFO\ttorchdistill.misc.log\tEpoch: [40] Total time: 0:00:45\n",
            "2021/05/24 23:50:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 89.0625 (89.0625)  acc5: 100.0000 (100.0000)  time: 0.7199  data: 0.6893  max mem: 700\n",
            "2021/05/24 23:50:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:50:30\tINFO\t__main__\t * Acc@1 87.5600\tAcc@5 99.4100\n",
            "\n",
            "2021/05/24 23:50:30\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.9700 -> 87.5600)\n",
            "2021/05/24 23:50:31\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [  0/391]  eta: 0:06:02  lr: 0.1  img/s: 329.56316058925574  loss: 0.5699 (0.5699)  time: 0.9261  data: 0.5377  max mem: 700\n",
            "2021/05/24 23:50:42\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1150.7820812085904  loss: 0.4893 (0.5214)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:50:53\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.808604842246  loss: 0.5438 (0.5401)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:51:05\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.163373263711  loss: 0.5181 (0.5446)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:51:15\tINFO\ttorchdistill.misc.log\tEpoch: [41] Total time: 0:00:45\n",
            "2021/05/24 23:51:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.6142  data: 0.5345  max mem: 700\n",
            "2021/05/24 23:51:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:51:17\tINFO\t__main__\t * Acc@1 86.3000\tAcc@5 99.2400\n",
            "\n",
            "2021/05/24 23:51:19\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [  0/391]  eta: 0:08:07  lr: 0.1  img/s: 314.6527537563744  loss: 0.5405 (0.5405)  time: 1.2473  data: 0.8405  max mem: 700\n",
            "2021/05/24 23:51:30\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.6639808783782  loss: 0.4740 (0.5260)  time: 0.1129  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:51:41\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.399415769131  loss: 0.4939 (0.5281)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:51:53\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.6359992495181  loss: 0.5249 (0.5313)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:52:03\tINFO\ttorchdistill.misc.log\tEpoch: [42] Total time: 0:00:45\n",
            "2021/05/24 23:52:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5548  data: 0.5088  max mem: 700\n",
            "2021/05/24 23:52:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:52:05\tINFO\t__main__\t * Acc@1 83.9900\tAcc@5 99.2400\n",
            "\n",
            "2021/05/24 23:52:07\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [  0/391]  eta: 0:07:03  lr: 0.1  img/s: 325.92821541446546  loss: 0.5302 (0.5302)  time: 1.0829  data: 0.6902  max mem: 700\n",
            "2021/05/24 23:52:18\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1144.3041980697747  loss: 0.5391 (0.5378)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:52:29\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.5267004149555  loss: 0.5430 (0.5431)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:52:41\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1140.2745642763994  loss: 0.4738 (0.5390)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:52:51\tINFO\ttorchdistill.misc.log\tEpoch: [43] Total time: 0:00:45\n",
            "2021/05/24 23:52:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5739  data: 0.5391  max mem: 700\n",
            "2021/05/24 23:52:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:52:53\tINFO\t__main__\t * Acc@1 83.5300\tAcc@5 99.4700\n",
            "\n",
            "2021/05/24 23:52:55\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [  0/391]  eta: 0:07:30  lr: 0.1  img/s: 311.9960296659271  loss: 0.5644 (0.5644)  time: 1.1522  data: 0.7419  max mem: 700\n",
            "2021/05/24 23:53:06\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.8548267956396  loss: 0.4885 (0.4984)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:53:17\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1145.187800497434  loss: 0.5287 (0.5174)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:53:29\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.164080185521  loss: 0.4949 (0.5196)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:53:39\tINFO\ttorchdistill.misc.log\tEpoch: [44] Total time: 0:00:45\n",
            "2021/05/24 23:53:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.5778  data: 0.5408  max mem: 700\n",
            "2021/05/24 23:53:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:53:41\tINFO\t__main__\t * Acc@1 85.2100\tAcc@5 99.3100\n",
            "\n",
            "2021/05/24 23:53:42\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [  0/391]  eta: 0:06:18  lr: 0.1  img/s: 343.3486344613055  loss: 0.4983 (0.4983)  time: 0.9676  data: 0.5947  max mem: 700\n",
            "2021/05/24 23:53:54\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.7532468634333  loss: 0.4973 (0.5021)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:54:05\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.2736754311684  loss: 0.5344 (0.5219)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:54:16\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1133.2319694692583  loss: 0.5403 (0.5116)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:54:27\tINFO\ttorchdistill.misc.log\tEpoch: [45] Total time: 0:00:45\n",
            "2021/05/24 23:54:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 83.5938 (83.5938)  acc5: 99.2188 (99.2188)  time: 0.5714  data: 0.5106  max mem: 700\n",
            "2021/05/24 23:54:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:54:29\tINFO\t__main__\t * Acc@1 84.7300\tAcc@5 99.2900\n",
            "\n",
            "2021/05/24 23:54:30\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [  0/391]  eta: 0:06:26  lr: 0.1  img/s: 294.14699161013795  loss: 0.4630 (0.4630)  time: 0.9895  data: 0.5543  max mem: 700\n",
            "2021/05/24 23:54:42\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1130.2807265010347  loss: 0.5333 (0.5017)  time: 0.1129  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:54:53\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.0942237899806  loss: 0.5064 (0.5070)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:55:04\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.5171837662879  loss: 0.4837 (0.5144)  time: 0.1120  data: 0.0002  max mem: 700\n",
            "2021/05/24 23:55:15\tINFO\ttorchdistill.misc.log\tEpoch: [46] Total time: 0:00:45\n",
            "2021/05/24 23:55:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5780  data: 0.5381  max mem: 700\n",
            "2021/05/24 23:55:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:55:17\tINFO\t__main__\t * Acc@1 87.1500\tAcc@5 99.5300\n",
            "\n",
            "2021/05/24 23:55:18\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [  0/391]  eta: 0:06:50  lr: 0.1  img/s: 326.1265991335217  loss: 0.4973 (0.4973)  time: 1.0504  data: 0.6579  max mem: 700\n",
            "2021/05/24 23:55:30\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1136.600370912971  loss: 0.5139 (0.5079)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:55:41\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.448795646164  loss: 0.5002 (0.5252)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:55:52\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1137.045706673331  loss: 0.5349 (0.5197)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:56:03\tINFO\ttorchdistill.misc.log\tEpoch: [47] Total time: 0:00:45\n",
            "2021/05/24 23:56:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.5515  data: 0.5074  max mem: 700\n",
            "2021/05/24 23:56:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:56:05\tINFO\t__main__\t * Acc@1 85.6700\tAcc@5 99.5300\n",
            "\n",
            "2021/05/24 23:56:06\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [  0/391]  eta: 0:06:59  lr: 0.1  img/s: 307.9094471208993  loss: 0.2935 (0.2935)  time: 1.0728  data: 0.6570  max mem: 700\n",
            "2021/05/24 23:56:18\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1143.538861979799  loss: 0.4945 (0.4898)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:56:29\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.4311434461222  loss: 0.5267 (0.5082)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:56:40\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.3993272639295  loss: 0.4981 (0.5131)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:56:51\tINFO\ttorchdistill.misc.log\tEpoch: [48] Total time: 0:00:45\n",
            "2021/05/24 23:56:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 87.5000 (87.5000)  acc5: 100.0000 (100.0000)  time: 0.6259  data: 0.5951  max mem: 700\n",
            "2021/05/24 23:56:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:56:53\tINFO\t__main__\t * Acc@1 86.9300\tAcc@5 99.6200\n",
            "\n",
            "2021/05/24 23:56:54\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [  0/391]  eta: 0:06:17  lr: 0.1  img/s: 329.6032219248054  loss: 0.4639 (0.4639)  time: 0.9647  data: 0.5763  max mem: 700\n",
            "2021/05/24 23:57:06\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1137.1251816237054  loss: 0.4826 (0.4986)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:57:17\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.3395785535579  loss: 0.4790 (0.5064)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:57:28\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.644781795019  loss: 0.4972 (0.5126)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:57:39\tINFO\ttorchdistill.misc.log\tEpoch: [49] Total time: 0:00:45\n",
            "2021/05/24 23:57:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 91.4062 (91.4062)  acc5: 99.2188 (99.2188)  time: 0.5459  data: 0.5155  max mem: 700\n",
            "2021/05/24 23:57:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:57:41\tINFO\t__main__\t * Acc@1 87.1900\tAcc@5 99.5700\n",
            "\n",
            "2021/05/24 23:57:42\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [  0/391]  eta: 0:05:48  lr: 0.1  img/s: 337.1508437705667  loss: 0.4127 (0.4127)  time: 0.8903  data: 0.5106  max mem: 700\n",
            "2021/05/24 23:57:54\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.440670146382  loss: 0.4944 (0.4805)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:58:05\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1160.2325172293815  loss: 0.4700 (0.4919)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:58:16\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1146.1608512237194  loss: 0.5038 (0.5008)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:58:26\tINFO\ttorchdistill.misc.log\tEpoch: [50] Total time: 0:00:45\n",
            "2021/05/24 23:58:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5843  data: 0.5512  max mem: 700\n",
            "2021/05/24 23:58:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:58:29\tINFO\t__main__\t * Acc@1 86.2400\tAcc@5 99.2600\n",
            "\n",
            "2021/05/24 23:58:30\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [  0/391]  eta: 0:08:40  lr: 0.1  img/s: 341.73658695563614  loss: 0.4056 (0.4056)  time: 1.3311  data: 0.9565  max mem: 700\n",
            "2021/05/24 23:58:42\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1132.6533922370324  loss: 0.5708 (0.4889)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:58:53\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.029087132092  loss: 0.4996 (0.5035)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:59:04\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.1512074525872  loss: 0.4692 (0.5085)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:59:14\tINFO\ttorchdistill.misc.log\tEpoch: [51] Total time: 0:00:45\n",
            "2021/05/24 23:59:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5404  data: 0.5094  max mem: 700\n",
            "2021/05/24 23:59:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/24 23:59:17\tINFO\t__main__\t * Acc@1 87.8500\tAcc@5 99.4300\n",
            "\n",
            "2021/05/24 23:59:17\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 87.5600 -> 87.8500)\n",
            "2021/05/24 23:59:18\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [  0/391]  eta: 0:06:12  lr: 0.1  img/s: 301.4257508681408  loss: 0.4914 (0.4914)  time: 0.9518  data: 0.5271  max mem: 700\n",
            "2021/05/24 23:59:29\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1135.9270123649044  loss: 0.4531 (0.4718)  time: 0.1129  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:59:41\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1140.965212383193  loss: 0.4652 (0.4762)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/24 23:59:52\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.5387939634495  loss: 0.5170 (0.4897)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:00:02\tINFO\ttorchdistill.misc.log\tEpoch: [52] Total time: 0:00:45\n",
            "2021/05/25 00:00:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.5848  data: 0.5645  max mem: 700\n",
            "2021/05/25 00:00:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:00:05\tINFO\t__main__\t * Acc@1 86.8100\tAcc@5 99.4500\n",
            "\n",
            "2021/05/25 00:00:06\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [  0/391]  eta: 0:05:56  lr: 0.1  img/s: 351.98510423755596  loss: 0.3207 (0.3207)  time: 0.9106  data: 0.5469  max mem: 700\n",
            "2021/05/25 00:00:17\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1144.5408307057994  loss: 0.4705 (0.4983)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:00:29\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.30235840834  loss: 0.5117 (0.5009)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:00:40\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.6887885429182  loss: 0.4696 (0.4961)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:00:50\tINFO\ttorchdistill.misc.log\tEpoch: [53] Total time: 0:00:45\n",
            "2021/05/25 00:00:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.6463  data: 0.6027  max mem: 700\n",
            "2021/05/25 00:00:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:00:53\tINFO\t__main__\t * Acc@1 84.0600\tAcc@5 99.1500\n",
            "\n",
            "2021/05/25 00:00:54\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [  0/391]  eta: 0:06:00  lr: 0.1  img/s: 301.37465048694656  loss: 0.4574 (0.4574)  time: 0.9230  data: 0.4982  max mem: 700\n",
            "2021/05/25 00:01:05\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1133.64833670483  loss: 0.4824 (0.4651)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:01:16\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.6436855588254  loss: 0.5058 (0.4963)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:01:28\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.833949759987  loss: 0.5526 (0.5012)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:01:38\tINFO\ttorchdistill.misc.log\tEpoch: [54] Total time: 0:00:45\n",
            "2021/05/25 00:01:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 89.8438 (89.8438)  acc5: 99.2188 (99.2188)  time: 0.5601  data: 0.5048  max mem: 700\n",
            "2021/05/25 00:01:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:01:40\tINFO\t__main__\t * Acc@1 86.7700\tAcc@5 99.5500\n",
            "\n",
            "2021/05/25 00:01:41\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [  0/391]  eta: 0:05:51  lr: 0.1  img/s: 346.9238561360837  loss: 0.6230 (0.6230)  time: 0.8997  data: 0.5307  max mem: 700\n",
            "2021/05/25 00:01:53\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1134.6762055927413  loss: 0.5018 (0.4703)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:02:04\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1134.1608402835873  loss: 0.4727 (0.4722)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:02:15\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.0534636064847  loss: 0.4620 (0.4813)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:02:26\tINFO\ttorchdistill.misc.log\tEpoch: [55] Total time: 0:00:45\n",
            "2021/05/25 00:02:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.6295  data: 0.6048  max mem: 700\n",
            "2021/05/25 00:02:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:02:28\tINFO\t__main__\t * Acc@1 83.3000\tAcc@5 99.2200\n",
            "\n",
            "2021/05/25 00:02:29\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [  0/391]  eta: 0:07:45  lr: 0.1  img/s: 325.3682253956114  loss: 0.3082 (0.3082)  time: 1.1912  data: 0.7978  max mem: 700\n",
            "2021/05/25 00:02:41\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.7768121818744  loss: 0.4562 (0.4722)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:02:52\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1132.223428530455  loss: 0.4817 (0.4863)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:03:03\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1138.6542240019003  loss: 0.4718 (0.4941)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:03:14\tINFO\ttorchdistill.misc.log\tEpoch: [56] Total time: 0:00:45\n",
            "2021/05/25 00:03:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6370  data: 0.6158  max mem: 700\n",
            "2021/05/25 00:03:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:03:16\tINFO\t__main__\t * Acc@1 87.1300\tAcc@5 99.4400\n",
            "\n",
            "2021/05/25 00:03:17\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [  0/391]  eta: 0:07:34  lr: 0.1  img/s: 314.63394468260924  loss: 0.4763 (0.4763)  time: 1.1618  data: 0.7549  max mem: 700\n",
            "2021/05/25 00:03:29\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1139.6258750907461  loss: 0.4662 (0.4725)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:03:40\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.7266780637417  loss: 0.4844 (0.4819)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:03:51\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1140.327847681838  loss: 0.4549 (0.4880)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:04:02\tINFO\ttorchdistill.misc.log\tEpoch: [57] Total time: 0:00:45\n",
            "2021/05/25 00:04:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6003  data: 0.5511  max mem: 700\n",
            "2021/05/25 00:04:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:04:04\tINFO\t__main__\t * Acc@1 87.0700\tAcc@5 99.3900\n",
            "\n",
            "2021/05/25 00:04:05\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [  0/391]  eta: 0:05:26  lr: 0.1  img/s: 375.89684646838066  loss: 0.3884 (0.3884)  time: 0.8362  data: 0.4957  max mem: 700\n",
            "2021/05/25 00:04:17\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1151.7325450184708  loss: 0.4901 (0.4759)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:04:28\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1140.8536827409173  loss: 0.4198 (0.4746)  time: 0.1126  data: 0.0006  max mem: 700\n",
            "2021/05/25 00:04:39\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1143.8117306176364  loss: 0.5184 (0.4847)  time: 0.1126  data: 0.0004  max mem: 700\n",
            "2021/05/25 00:04:49\tINFO\ttorchdistill.misc.log\tEpoch: [58] Total time: 0:00:45\n",
            "2021/05/25 00:04:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 89.0625 (89.0625)  acc5: 99.2188 (99.2188)  time: 0.6040  data: 0.5725  max mem: 700\n",
            "2021/05/25 00:04:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:04:52\tINFO\t__main__\t * Acc@1 88.8500\tAcc@5 99.4900\n",
            "\n",
            "2021/05/25 00:04:52\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 87.8500 -> 88.8500)\n",
            "2021/05/25 00:04:53\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [  0/391]  eta: 0:06:43  lr: 0.1  img/s: 330.95133599021085  loss: 0.5343 (0.5343)  time: 1.0326  data: 0.6458  max mem: 700\n",
            "2021/05/25 00:05:05\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1132.4861453305882  loss: 0.4958 (0.4745)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:05:16\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.0192174918568  loss: 0.4347 (0.4815)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:05:27\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.6113606452982  loss: 0.4679 (0.4894)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:05:37\tINFO\ttorchdistill.misc.log\tEpoch: [59] Total time: 0:00:45\n",
            "2021/05/25 00:05:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 84.3750 (84.3750)  acc5: 99.2188 (99.2188)  time: 0.5632  data: 0.5166  max mem: 700\n",
            "2021/05/25 00:05:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:05:40\tINFO\t__main__\t * Acc@1 84.1300\tAcc@5 99.4100\n",
            "\n",
            "2021/05/25 00:05:41\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [  0/391]  eta: 0:05:31  lr: 0.1  img/s: 381.07383040053605  loss: 0.3798 (0.3798)  time: 0.8476  data: 0.5117  max mem: 700\n",
            "2021/05/25 00:05:52\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1148.8219325819616  loss: 0.4771 (0.4764)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:06:03\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.5690901662076  loss: 0.4474 (0.4805)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:06:15\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1142.8888874696913  loss: 0.5126 (0.4861)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:06:25\tINFO\ttorchdistill.misc.log\tEpoch: [60] Total time: 0:00:45\n",
            "2021/05/25 00:06:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5266  data: 0.4964  max mem: 700\n",
            "2021/05/25 00:06:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:06:27\tINFO\t__main__\t * Acc@1 87.5400\tAcc@5 99.4900\n",
            "\n",
            "2021/05/25 00:06:29\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [  0/391]  eta: 0:07:37  lr: 0.1  img/s: 347.47194605835176  loss: 0.6429 (0.6429)  time: 1.1699  data: 0.8015  max mem: 700\n",
            "2021/05/25 00:06:40\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1136.687003506157  loss: 0.4414 (0.4627)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:06:51\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.6967145423432  loss: 0.5111 (0.4720)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:07:03\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1142.4924496501474  loss: 0.5130 (0.4825)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:07:13\tINFO\ttorchdistill.misc.log\tEpoch: [61] Total time: 0:00:45\n",
            "2021/05/25 00:07:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5460  data: 0.4972  max mem: 700\n",
            "2021/05/25 00:07:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:07:15\tINFO\t__main__\t * Acc@1 83.6800\tAcc@5 99.3600\n",
            "\n",
            "2021/05/25 00:07:16\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [  0/391]  eta: 0:06:16  lr: 0.1  img/s: 384.1113604102752  loss: 0.4098 (0.4098)  time: 0.9626  data: 0.6293  max mem: 700\n",
            "2021/05/25 00:07:28\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.427260968214  loss: 0.4460 (0.4577)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:07:39\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1143.4414404436852  loss: 0.4457 (0.4592)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:07:50\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.5078935296315  loss: 0.4682 (0.4744)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:08:01\tINFO\ttorchdistill.misc.log\tEpoch: [62] Total time: 0:00:45\n",
            "2021/05/25 00:08:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:52  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6601  data: 0.6418  max mem: 700\n",
            "2021/05/25 00:08:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:08:03\tINFO\t__main__\t * Acc@1 87.1900\tAcc@5 99.4500\n",
            "\n",
            "2021/05/25 00:08:04\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [  0/391]  eta: 0:07:40  lr: 0.1  img/s: 307.4921917150735  loss: 0.5380 (0.5380)  time: 1.1776  data: 0.7613  max mem: 700\n",
            "2021/05/25 00:08:16\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1143.239343703751  loss: 0.4807 (0.4339)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:08:27\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1149.1514397813305  loss: 0.4305 (0.4542)  time: 0.1127  data: 0.0008  max mem: 700\n",
            "2021/05/25 00:08:38\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.6916572524049  loss: 0.4399 (0.4645)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:08:48\tINFO\ttorchdistill.misc.log\tEpoch: [63] Total time: 0:00:45\n",
            "2021/05/25 00:08:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 89.8438 (89.8438)  acc5: 99.2188 (99.2188)  time: 0.6333  data: 0.5633  max mem: 700\n",
            "2021/05/25 00:08:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:08:51\tINFO\t__main__\t * Acc@1 87.2000\tAcc@5 99.5600\n",
            "\n",
            "2021/05/25 00:08:52\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [  0/391]  eta: 0:08:24  lr: 0.1  img/s: 352.0093367192054  loss: 0.4071 (0.4071)  time: 1.2907  data: 0.9270  max mem: 700\n",
            "2021/05/25 00:09:04\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1139.5654006737152  loss: 0.4868 (0.4595)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:09:15\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.5238299225957  loss: 0.5317 (0.4728)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:09:26\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.2999321858067  loss: 0.5123 (0.4804)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:09:36\tINFO\ttorchdistill.misc.log\tEpoch: [64] Total time: 0:00:45\n",
            "2021/05/25 00:09:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 89.0625 (89.0625)  acc5: 100.0000 (100.0000)  time: 0.5620  data: 0.5404  max mem: 700\n",
            "2021/05/25 00:09:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:09:39\tINFO\t__main__\t * Acc@1 88.5600\tAcc@5 99.5600\n",
            "\n",
            "2021/05/25 00:09:40\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [  0/391]  eta: 0:05:58  lr: 0.1  img/s: 317.09419430439857  loss: 0.4365 (0.4365)  time: 0.9181  data: 0.5144  max mem: 700\n",
            "2021/05/25 00:09:51\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.0404085956545  loss: 0.4566 (0.4658)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:10:02\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.173782827263  loss: 0.4277 (0.4633)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:10:14\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.986965030205  loss: 0.4761 (0.4662)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:10:24\tINFO\ttorchdistill.misc.log\tEpoch: [65] Total time: 0:00:45\n",
            "2021/05/25 00:10:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 87.5000 (87.5000)  acc5: 98.4375 (98.4375)  time: 0.5916  data: 0.5470  max mem: 700\n",
            "2021/05/25 00:10:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:10:26\tINFO\t__main__\t * Acc@1 84.8900\tAcc@5 99.0400\n",
            "\n",
            "2021/05/25 00:10:27\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [  0/391]  eta: 0:06:17  lr: 0.1  img/s: 325.8413748107147  loss: 0.3878 (0.3878)  time: 0.9649  data: 0.5721  max mem: 700\n",
            "2021/05/25 00:10:39\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.523187848041  loss: 0.4052 (0.4588)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:10:50\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1146.0898946923492  loss: 0.4009 (0.4633)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:11:01\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1140.6258421308698  loss: 0.4643 (0.4764)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:11:12\tINFO\ttorchdistill.misc.log\tEpoch: [66] Total time: 0:00:45\n",
            "2021/05/25 00:11:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 89.8438 (89.8438)  acc5: 99.2188 (99.2188)  time: 0.5064  data: 0.4872  max mem: 700\n",
            "2021/05/25 00:11:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:11:14\tINFO\t__main__\t * Acc@1 85.8200\tAcc@5 99.1700\n",
            "\n",
            "2021/05/25 00:11:15\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [  0/391]  eta: 0:06:11  lr: 0.1  img/s: 364.88717857400155  loss: 0.4232 (0.4232)  time: 0.9508  data: 0.5999  max mem: 700\n",
            "2021/05/25 00:11:27\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.1242918572111  loss: 0.4609 (0.4582)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:11:38\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1150.794414840029  loss: 0.4811 (0.4592)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:11:49\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.4483918926146  loss: 0.4305 (0.4616)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:11:59\tINFO\ttorchdistill.misc.log\tEpoch: [67] Total time: 0:00:45\n",
            "2021/05/25 00:12:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.6001  data: 0.5833  max mem: 700\n",
            "2021/05/25 00:12:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:12:02\tINFO\t__main__\t * Acc@1 87.8800\tAcc@5 99.5100\n",
            "\n",
            "2021/05/25 00:12:03\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [  0/391]  eta: 0:05:31  lr: 0.1  img/s: 374.1187712016769  loss: 0.4101 (0.4101)  time: 0.8471  data: 0.5049  max mem: 700\n",
            "2021/05/25 00:12:14\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.986059807166  loss: 0.4778 (0.4630)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:12:26\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1133.9548252191362  loss: 0.4287 (0.4573)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:12:37\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.5024419567314  loss: 0.4876 (0.4652)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:12:47\tINFO\ttorchdistill.misc.log\tEpoch: [68] Total time: 0:00:45\n",
            "2021/05/25 00:12:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5680  data: 0.5199  max mem: 700\n",
            "2021/05/25 00:12:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:12:50\tINFO\t__main__\t * Acc@1 87.5700\tAcc@5 99.4300\n",
            "\n",
            "2021/05/25 00:12:51\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [  0/391]  eta: 0:06:38  lr: 0.1  img/s: 333.57124607944013  loss: 0.4686 (0.4686)  time: 1.0195  data: 0.6357  max mem: 700\n",
            "2021/05/25 00:13:02\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1140.0372714068512  loss: 0.4781 (0.4606)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:13:14\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1147.2041916142073  loss: 0.4498 (0.4569)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:13:25\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.8096411941933  loss: 0.4513 (0.4640)  time: 0.1127  data: 0.0008  max mem: 700\n",
            "2021/05/25 00:13:35\tINFO\ttorchdistill.misc.log\tEpoch: [69] Total time: 0:00:45\n",
            "2021/05/25 00:13:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5656  data: 0.5206  max mem: 700\n",
            "2021/05/25 00:13:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:13:38\tINFO\t__main__\t * Acc@1 85.1300\tAcc@5 99.3000\n",
            "\n",
            "2021/05/25 00:13:39\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [  0/391]  eta: 0:06:40  lr: 0.1  img/s: 344.3082562782423  loss: 0.3829 (0.3829)  time: 1.0250  data: 0.6532  max mem: 700\n",
            "2021/05/25 00:13:50\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1149.7248391711425  loss: 0.4810 (0.4592)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:14:01\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1144.3993272639295  loss: 0.4930 (0.4594)  time: 0.1128  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:14:13\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1137.6673525391764  loss: 0.4855 (0.4686)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:14:23\tINFO\ttorchdistill.misc.log\tEpoch: [70] Total time: 0:00:45\n",
            "2021/05/25 00:14:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:54  acc1: 91.4062 (91.4062)  acc5: 99.2188 (99.2188)  time: 0.6913  data: 0.6699  max mem: 700\n",
            "2021/05/25 00:14:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:14:25\tINFO\t__main__\t * Acc@1 87.6600\tAcc@5 99.4500\n",
            "\n",
            "2021/05/25 00:14:27\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [  0/391]  eta: 0:07:59  lr: 0.1  img/s: 356.4638464061531  loss: 0.2649 (0.2649)  time: 1.2253  data: 0.8662  max mem: 700\n",
            "2021/05/25 00:14:38\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1144.0237809594637  loss: 0.4463 (0.4436)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:14:49\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1134.611459583749  loss: 0.4425 (0.4730)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:15:00\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.9748194629087  loss: 0.4257 (0.4750)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:15:11\tINFO\ttorchdistill.misc.log\tEpoch: [71] Total time: 0:00:45\n",
            "2021/05/25 00:15:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5491  data: 0.5090  max mem: 700\n",
            "2021/05/25 00:15:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:15:13\tINFO\t__main__\t * Acc@1 88.7200\tAcc@5 99.6400\n",
            "\n",
            "2021/05/25 00:15:14\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [  0/391]  eta: 0:05:32  lr: 0.1  img/s: 389.00898558726584  loss: 0.5456 (0.5456)  time: 0.8510  data: 0.5219  max mem: 700\n",
            "2021/05/25 00:15:26\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1148.6572498341857  loss: 0.4599 (0.4535)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:15:37\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1138.0073765696407  loss: 0.4623 (0.4548)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:15:48\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.6506419686755  loss: 0.4504 (0.4558)  time: 0.1123  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:15:58\tINFO\ttorchdistill.misc.log\tEpoch: [72] Total time: 0:00:45\n",
            "2021/05/25 00:15:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 90.6250 (90.6250)  acc5: 100.0000 (100.0000)  time: 0.5653  data: 0.5135  max mem: 700\n",
            "2021/05/25 00:16:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:16:01\tINFO\t__main__\t * Acc@1 87.0800\tAcc@5 99.5100\n",
            "\n",
            "2021/05/25 00:16:02\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [  0/391]  eta: 0:08:13  lr: 0.1  img/s: 354.6497450796205  loss: 0.4085 (0.4085)  time: 1.2618  data: 0.9008  max mem: 700\n",
            "2021/05/25 00:16:13\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1141.3266212010408  loss: 0.4580 (0.4349)  time: 0.1129  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:16:25\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1143.0300176073206  loss: 0.4153 (0.4459)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:16:36\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1138.0749232621636  loss: 0.4788 (0.4580)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:16:46\tINFO\ttorchdistill.misc.log\tEpoch: [73] Total time: 0:00:45\n",
            "2021/05/25 00:16:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 88.2812 (88.2812)  acc5: 98.4375 (98.4375)  time: 0.5649  data: 0.5374  max mem: 700\n",
            "2021/05/25 00:16:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:16:49\tINFO\t__main__\t * Acc@1 88.0800\tAcc@5 99.4400\n",
            "\n",
            "2021/05/25 00:16:50\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [  0/391]  eta: 0:06:14  lr: 0.1  img/s: 345.7034644982778  loss: 0.4004 (0.4004)  time: 0.9574  data: 0.5872  max mem: 700\n",
            "2021/05/25 00:17:01\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1139.1978543131233  loss: 0.4346 (0.4268)  time: 0.1124  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:17:12\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.4817514227238  loss: 0.3939 (0.4361)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:17:24\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.3529802961966  loss: 0.4475 (0.4510)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:17:34\tINFO\ttorchdistill.misc.log\tEpoch: [74] Total time: 0:00:45\n",
            "2021/05/25 00:17:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5687  data: 0.5117  max mem: 700\n",
            "2021/05/25 00:17:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:17:36\tINFO\t__main__\t * Acc@1 87.8400\tAcc@5 99.4400\n",
            "\n",
            "2021/05/25 00:17:37\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [  0/391]  eta: 0:05:17  lr: 0.1  img/s: 412.7553717229184  loss: 0.3962 (0.3962)  time: 0.8121  data: 0.5020  max mem: 700\n",
            "2021/05/25 00:17:49\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1142.259093462239  loss: 0.4377 (0.4583)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:18:00\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.458412601133  loss: 0.4362 (0.4551)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:18:11\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.676910963623  loss: 0.4816 (0.4585)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:18:22\tINFO\ttorchdistill.misc.log\tEpoch: [75] Total time: 0:00:45\n",
            "2021/05/25 00:18:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.5468  data: 0.4875  max mem: 700\n",
            "2021/05/25 00:18:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:18:24\tINFO\t__main__\t * Acc@1 88.0100\tAcc@5 99.5300\n",
            "\n",
            "2021/05/25 00:18:25\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [  0/391]  eta: 0:05:24  lr: 0.1  img/s: 377.8612359807575  loss: 0.2975 (0.2975)  time: 0.8288  data: 0.4900  max mem: 700\n",
            "2021/05/25 00:18:36\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [100/391]  eta: 0:00:35  lr: 0.1  img/s: 1138.2510648492673  loss: 0.4286 (0.4411)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:18:48\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.746843182378  loss: 0.4222 (0.4479)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:18:59\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1144.748269671163  loss: 0.5195 (0.4604)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:19:09\tINFO\ttorchdistill.misc.log\tEpoch: [76] Total time: 0:00:45\n",
            "2021/05/25 00:19:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5982  data: 0.5648  max mem: 700\n",
            "2021/05/25 00:19:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:19:12\tINFO\t__main__\t * Acc@1 83.6900\tAcc@5 99.4000\n",
            "\n",
            "2021/05/25 00:19:13\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [  0/391]  eta: 0:07:29  lr: 0.1  img/s: 342.79135779294  loss: 0.5620 (0.5620)  time: 1.1487  data: 0.7753  max mem: 700\n",
            "2021/05/25 00:19:24\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1137.8216645013893  loss: 0.4059 (0.4428)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:19:35\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.8402299853758  loss: 0.4580 (0.4524)  time: 0.1125  data: 0.0004  max mem: 700\n",
            "2021/05/25 00:19:47\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.4606755513723  loss: 0.4613 (0.4563)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:19:57\tINFO\ttorchdistill.misc.log\tEpoch: [77] Total time: 0:00:45\n",
            "2021/05/25 00:19:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.5854  data: 0.5349  max mem: 700\n",
            "2021/05/25 00:19:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:19:59\tINFO\t__main__\t * Acc@1 84.3500\tAcc@5 99.4600\n",
            "\n",
            "2021/05/25 00:20:00\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [  0/391]  eta: 0:06:14  lr: 0.1  img/s: 361.80454622035626  loss: 0.5971 (0.5971)  time: 0.9581  data: 0.6043  max mem: 700\n",
            "2021/05/25 00:20:12\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.7263705820662  loss: 0.3664 (0.4504)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:20:23\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.1664304326055  loss: 0.4608 (0.4467)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:20:34\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1147.7903720632912  loss: 0.4555 (0.4485)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:20:45\tINFO\ttorchdistill.misc.log\tEpoch: [78] Total time: 0:00:45\n",
            "2021/05/25 00:20:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5466  data: 0.5047  max mem: 700\n",
            "2021/05/25 00:20:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:20:47\tINFO\t__main__\t * Acc@1 88.9300\tAcc@5 99.4800\n",
            "\n",
            "2021/05/25 00:20:47\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 88.8500 -> 88.9300)\n",
            "2021/05/25 00:20:48\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [  0/391]  eta: 0:05:31  lr: 0.1  img/s: 372.2977905713198  loss: 0.3600 (0.3600)  time: 0.8489  data: 0.5050  max mem: 700\n",
            "2021/05/25 00:21:00\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1136.9686506633911  loss: 0.3863 (0.4337)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:21:11\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.6602333119786  loss: 0.4006 (0.4378)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:21:22\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1137.7372699607524  loss: 0.4184 (0.4445)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:21:32\tINFO\ttorchdistill.misc.log\tEpoch: [79] Total time: 0:00:45\n",
            "2021/05/25 00:21:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 91.4062 (91.4062)  acc5: 99.2188 (99.2188)  time: 0.5600  data: 0.5318  max mem: 700\n",
            "2021/05/25 00:21:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:21:35\tINFO\t__main__\t * Acc@1 86.5200\tAcc@5 99.2700\n",
            "\n",
            "2021/05/25 00:21:36\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [  0/391]  eta: 0:05:48  lr: 0.1  img/s: 336.20496275180733  loss: 0.2965 (0.2965)  time: 0.8902  data: 0.5095  max mem: 700\n",
            "2021/05/25 00:21:47\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1145.992038029615  loss: 0.3862 (0.4324)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:21:58\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1142.4535503311145  loss: 0.4504 (0.4362)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:22:10\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1130.3307001734854  loss: 0.3895 (0.4346)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:22:20\tINFO\ttorchdistill.misc.log\tEpoch: [80] Total time: 0:00:45\n",
            "2021/05/25 00:22:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5598  data: 0.5123  max mem: 700\n",
            "2021/05/25 00:22:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:22:22\tINFO\t__main__\t * Acc@1 88.7900\tAcc@5 99.5500\n",
            "\n",
            "2021/05/25 00:22:23\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [  0/391]  eta: 0:05:55  lr: 0.1  img/s: 333.521304835358  loss: 0.5102 (0.5102)  time: 0.9086  data: 0.5247  max mem: 700\n",
            "2021/05/25 00:22:35\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.0067154637106  loss: 0.3822 (0.4243)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:22:46\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1146.870900072204  loss: 0.4427 (0.4405)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:22:57\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1135.0240420799823  loss: 0.4685 (0.4484)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:23:08\tINFO\ttorchdistill.misc.log\tEpoch: [81] Total time: 0:00:45\n",
            "2021/05/25 00:23:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5636  data: 0.5112  max mem: 700\n",
            "2021/05/25 00:23:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:23:10\tINFO\t__main__\t * Acc@1 85.5400\tAcc@5 99.5100\n",
            "\n",
            "2021/05/25 00:23:11\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [  0/391]  eta: 0:06:35  lr: 0.1  img/s: 337.8526985629312  loss: 0.4095 (0.4095)  time: 1.0105  data: 0.6316  max mem: 700\n",
            "2021/05/25 00:23:23\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.8669910890287  loss: 0.4129 (0.4183)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:23:34\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1146.3395048416198  loss: 0.3791 (0.4310)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:23:45\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.0852131181107  loss: 0.4419 (0.4396)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:23:55\tINFO\ttorchdistill.misc.log\tEpoch: [82] Total time: 0:00:45\n",
            "2021/05/25 00:23:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 87.5000 (87.5000)  acc5: 99.2188 (99.2188)  time: 0.5841  data: 0.5576  max mem: 700\n",
            "2021/05/25 00:23:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:23:58\tINFO\t__main__\t * Acc@1 88.2800\tAcc@5 99.5600\n",
            "\n",
            "2021/05/25 00:23:59\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [  0/391]  eta: 0:05:42  lr: 0.1  img/s: 344.3990344244491  loss: 0.4593 (0.4593)  time: 0.8764  data: 0.5047  max mem: 700\n",
            "2021/05/25 00:24:10\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.6994284347313  loss: 0.4202 (0.4296)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:24:22\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1136.4680410581643  loss: 0.4211 (0.4430)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:24:33\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1134.6162553310198  loss: 0.4428 (0.4436)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:24:43\tINFO\ttorchdistill.misc.log\tEpoch: [83] Total time: 0:00:45\n",
            "2021/05/25 00:24:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 88.2812 (88.2812)  acc5: 98.4375 (98.4375)  time: 0.5384  data: 0.5160  max mem: 700\n",
            "2021/05/25 00:24:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:24:45\tINFO\t__main__\t * Acc@1 84.8100\tAcc@5 99.4400\n",
            "\n",
            "2021/05/25 00:24:46\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [  0/391]  eta: 0:05:56  lr: 0.1  img/s: 326.0885667846618  loss: 0.4822 (0.4822)  time: 0.9108  data: 0.5182  max mem: 700\n",
            "2021/05/25 00:24:58\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1142.205629427909  loss: 0.4773 (0.4422)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:25:09\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1139.46139968843  loss: 0.4364 (0.4434)  time: 0.1126  data: 0.0005  max mem: 700\n",
            "2021/05/25 00:25:20\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1148.716235241759  loss: 0.4422 (0.4443)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:25:31\tINFO\ttorchdistill.misc.log\tEpoch: [84] Total time: 0:00:45\n",
            "2021/05/25 00:25:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5485  data: 0.5138  max mem: 700\n",
            "2021/05/25 00:25:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:25:33\tINFO\t__main__\t * Acc@1 86.7800\tAcc@5 99.5500\n",
            "\n",
            "2021/05/25 00:25:34\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [  0/391]  eta: 0:06:20  lr: 0.1  img/s: 332.7661386995323  loss: 0.3589 (0.3589)  time: 0.9730  data: 0.5884  max mem: 700\n",
            "2021/05/25 00:25:46\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1137.3925880102283  loss: 0.3627 (0.4207)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:25:57\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.2659661534342  loss: 0.3807 (0.4241)  time: 0.1124  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:26:08\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1142.6237544109072  loss: 0.4141 (0.4302)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:26:19\tINFO\ttorchdistill.misc.log\tEpoch: [85] Total time: 0:00:45\n",
            "2021/05/25 00:26:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.7107  data: 0.6670  max mem: 700\n",
            "2021/05/25 00:26:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:26:21\tINFO\t__main__\t * Acc@1 87.5200\tAcc@5 99.4800\n",
            "\n",
            "2021/05/25 00:26:22\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [  0/391]  eta: 0:08:26  lr: 0.1  img/s: 327.08727409863354  loss: 0.4011 (0.4011)  time: 1.2964  data: 0.9050  max mem: 700\n",
            "2021/05/25 00:26:34\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1127.81135603083  loss: 0.3814 (0.4220)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:26:45\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1150.7105513593224  loss: 0.4401 (0.4290)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:26:56\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1147.0669304629112  loss: 0.4630 (0.4451)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:27:06\tINFO\ttorchdistill.misc.log\tEpoch: [86] Total time: 0:00:45\n",
            "2021/05/25 00:27:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 89.8438 (89.8438)  acc5: 99.2188 (99.2188)  time: 0.5516  data: 0.5050  max mem: 700\n",
            "2021/05/25 00:27:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:27:09\tINFO\t__main__\t * Acc@1 87.2800\tAcc@5 99.3900\n",
            "\n",
            "2021/05/25 00:27:10\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [  0/391]  eta: 0:06:16  lr: 0.1  img/s: 330.86118669063575  loss: 0.5916 (0.5916)  time: 0.9619  data: 0.5750  max mem: 700\n",
            "2021/05/25 00:27:21\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1138.8691979542093  loss: 0.3917 (0.4234)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:27:33\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1145.6252243255296  loss: 0.4249 (0.4304)  time: 0.1121  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:27:44\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1145.4345739857692  loss: 0.4287 (0.4433)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:27:54\tINFO\ttorchdistill.misc.log\tEpoch: [87] Total time: 0:00:45\n",
            "2021/05/25 00:27:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 91.4062 (91.4062)  acc5: 98.4375 (98.4375)  time: 0.7173  data: 0.7012  max mem: 700\n",
            "2021/05/25 00:27:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:27:56\tINFO\t__main__\t * Acc@1 86.7900\tAcc@5 99.2800\n",
            "\n",
            "2021/05/25 00:27:57\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [  0/391]  eta: 0:05:45  lr: 0.1  img/s: 363.18300030171054  loss: 0.4889 (0.4889)  time: 0.8849  data: 0.5324  max mem: 700\n",
            "2021/05/25 00:28:09\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1137.9929033215337  loss: 0.3644 (0.4207)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:28:20\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1141.8412352715982  loss: 0.4161 (0.4230)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:28:32\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1140.9749116435053  loss: 0.4138 (0.4342)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:28:42\tINFO\ttorchdistill.misc.log\tEpoch: [88] Total time: 0:00:45\n",
            "2021/05/25 00:28:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 89.0625 (89.0625)  acc5: 99.2188 (99.2188)  time: 0.5398  data: 0.5018  max mem: 700\n",
            "2021/05/25 00:28:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:28:44\tINFO\t__main__\t * Acc@1 87.0700\tAcc@5 99.4100\n",
            "\n",
            "2021/05/25 00:28:45\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [  0/391]  eta: 0:06:05  lr: 0.1  img/s: 319.41866817390786  loss: 0.3221 (0.3221)  time: 0.9358  data: 0.5351  max mem: 700\n",
            "2021/05/25 00:28:57\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1135.1944398043697  loss: 0.4200 (0.4232)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:29:08\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1137.7830825864617  loss: 0.3976 (0.4288)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:29:19\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1139.4178700284392  loss: 0.4163 (0.4420)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:29:30\tINFO\ttorchdistill.misc.log\tEpoch: [89] Total time: 0:00:45\n",
            "2021/05/25 00:29:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.5574  data: 0.5175  max mem: 700\n",
            "2021/05/25 00:29:32\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:29:32\tINFO\t__main__\t * Acc@1 87.2500\tAcc@5 99.4700\n",
            "\n",
            "2021/05/25 00:29:33\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [  0/391]  eta: 0:08:21  lr: 0.1  img/s: 342.39653056799193  loss: 0.3153 (0.3153)  time: 1.2833  data: 0.9094  max mem: 700\n",
            "2021/05/25 00:29:45\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [100/391]  eta: 0:00:36  lr: 0.1  img/s: 1146.1045746331904  loss: 0.3927 (0.4062)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:29:56\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [200/391]  eta: 0:00:22  lr: 0.1  img/s: 1135.3985043819578  loss: 0.5114 (0.4401)  time: 0.1126  data: 0.0004  max mem: 700\n",
            "2021/05/25 00:30:07\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [300/391]  eta: 0:00:10  lr: 0.1  img/s: 1141.3314738833733  loss: 0.4525 (0.4451)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:30:17\tINFO\ttorchdistill.misc.log\tEpoch: [90] Total time: 0:00:45\n",
            "2021/05/25 00:30:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.5882  data: 0.5315  max mem: 700\n",
            "2021/05/25 00:30:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:30:20\tINFO\t__main__\t * Acc@1 87.6000\tAcc@5 99.5500\n",
            "\n",
            "2021/05/25 00:30:21\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [  0/391]  eta: 0:06:24  lr: 0.010000000000000002  img/s: 340.39149488719363  loss: 0.5606 (0.5606)  time: 0.9843  data: 0.6082  max mem: 700\n",
            "2021/05/25 00:30:32\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1143.4950202342918  loss: 0.3035 (0.3489)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:30:44\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1142.4486881024834  loss: 0.2994 (0.3246)  time: 0.1120  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:30:55\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1145.5983338952453  loss: 0.2407 (0.3081)  time: 0.1125  data: 0.0004  max mem: 700\n",
            "2021/05/25 00:31:05\tINFO\ttorchdistill.misc.log\tEpoch: [91] Total time: 0:00:45\n",
            "2021/05/25 00:31:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5565  data: 0.5235  max mem: 700\n",
            "2021/05/25 00:31:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:31:08\tINFO\t__main__\t * Acc@1 91.4700\tAcc@5 99.7100\n",
            "\n",
            "2021/05/25 00:31:08\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 88.9300 -> 91.4700)\n",
            "2021/05/25 00:31:09\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [  0/391]  eta: 0:08:18  lr: 0.010000000000000002  img/s: 356.86547058076707  loss: 0.2242 (0.2242)  time: 1.2749  data: 0.9162  max mem: 700\n",
            "2021/05/25 00:31:20\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1141.0694880743383  loss: 0.2559 (0.2466)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:31:31\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1143.443875779784  loss: 0.2381 (0.2431)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:31:43\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1149.6165139186296  loss: 0.1966 (0.2409)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:31:53\tINFO\ttorchdistill.misc.log\tEpoch: [92] Total time: 0:00:45\n",
            "2021/05/25 00:31:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5437  data: 0.4995  max mem: 700\n",
            "2021/05/25 00:31:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:31:55\tINFO\t__main__\t * Acc@1 91.7800\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 00:31:55\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.4700 -> 91.7800)\n",
            "2021/05/25 00:31:56\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [  0/391]  eta: 0:05:40  lr: 0.010000000000000002  img/s: 353.70834906297455  loss: 0.2094 (0.2094)  time: 0.8715  data: 0.5095  max mem: 700\n",
            "2021/05/25 00:32:08\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [100/391]  eta: 0:00:35  lr: 0.010000000000000002  img/s: 1148.3280259409144  loss: 0.2278 (0.2264)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:32:19\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.843472716533  loss: 0.1842 (0.2224)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:32:30\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1144.7531514934412  loss: 0.1903 (0.2219)  time: 0.1123  data: 0.0005  max mem: 700\n",
            "2021/05/25 00:32:41\tINFO\ttorchdistill.misc.log\tEpoch: [93] Total time: 0:00:45\n",
            "2021/05/25 00:32:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5810  data: 0.5605  max mem: 700\n",
            "2021/05/25 00:32:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:32:43\tINFO\t__main__\t * Acc@1 91.7900\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 00:32:43\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.7800 -> 91.7900)\n",
            "2021/05/25 00:32:44\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [  0/391]  eta: 0:06:22  lr: 0.010000000000000002  img/s: 332.3535185014371  loss: 0.1428 (0.1428)  time: 0.9782  data: 0.5930  max mem: 700\n",
            "2021/05/25 00:32:56\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1145.5958893732702  loss: 0.2174 (0.2055)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:33:07\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1146.841501292376  loss: 0.1972 (0.2109)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:33:18\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1133.138687733621  loss: 0.2030 (0.2105)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:33:28\tINFO\ttorchdistill.misc.log\tEpoch: [94] Total time: 0:00:45\n",
            "2021/05/25 00:33:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5346  data: 0.4975  max mem: 700\n",
            "2021/05/25 00:33:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:33:31\tINFO\t__main__\t * Acc@1 91.8500\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 00:33:31\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.7900 -> 91.8500)\n",
            "2021/05/25 00:33:32\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [  0/391]  eta: 0:07:20  lr: 0.010000000000000002  img/s: 334.68126069897255  loss: 0.1367 (0.1367)  time: 1.1274  data: 0.7449  max mem: 700\n",
            "2021/05/25 00:33:43\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1149.0973286159785  loss: 0.2027 (0.2033)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:33:55\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.8556793803925  loss: 0.2008 (0.2015)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:34:06\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1140.4513874579663  loss: 0.1993 (0.2014)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:34:16\tINFO\ttorchdistill.misc.log\tEpoch: [95] Total time: 0:00:45\n",
            "2021/05/25 00:34:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5778  data: 0.5167  max mem: 700\n",
            "2021/05/25 00:34:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:34:18\tINFO\t__main__\t * Acc@1 91.7800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:34:19\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [  0/391]  eta: 0:06:03  lr: 0.010000000000000002  img/s: 355.4283126667505  loss: 0.1383 (0.1383)  time: 0.9293  data: 0.5691  max mem: 700\n",
            "2021/05/25 00:34:31\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1146.4423170963478  loss: 0.1884 (0.1960)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:34:42\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1150.0105218061863  loss: 0.2027 (0.1963)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:34:53\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.684864446563  loss: 0.1844 (0.1927)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:35:04\tINFO\ttorchdistill.misc.log\tEpoch: [96] Total time: 0:00:45\n",
            "2021/05/25 00:35:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5570  data: 0.4962  max mem: 700\n",
            "2021/05/25 00:35:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:35:06\tINFO\t__main__\t * Acc@1 91.8400\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:35:07\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [  0/391]  eta: 0:06:18  lr: 0.010000000000000002  img/s: 336.55988946646505  loss: 0.1504 (0.1504)  time: 0.9691  data: 0.5887  max mem: 700\n",
            "2021/05/25 00:35:19\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1128.1834442875395  loss: 0.1547 (0.1848)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:35:30\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.510337676082  loss: 0.1723 (0.1898)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:35:41\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1145.9993766996674  loss: 0.1892 (0.1920)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:35:51\tINFO\ttorchdistill.misc.log\tEpoch: [97] Total time: 0:00:45\n",
            "2021/05/25 00:35:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6230  data: 0.5477  max mem: 700\n",
            "2021/05/25 00:35:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:35:54\tINFO\t__main__\t * Acc@1 91.7300\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 00:35:55\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [  0/391]  eta: 0:06:08  lr: 0.010000000000000002  img/s: 365.09958802511835  loss: 0.1425 (0.1425)  time: 0.9424  data: 0.5918  max mem: 700\n",
            "2021/05/25 00:36:06\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1141.5474600309165  loss: 0.1826 (0.1930)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:36:18\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1143.9701516071639  loss: 0.1870 (0.1897)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:36:29\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1140.0469548967978  loss: 0.1878 (0.1870)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:36:39\tINFO\ttorchdistill.misc.log\tEpoch: [98] Total time: 0:00:45\n",
            "2021/05/25 00:36:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5122  data: 0.4778  max mem: 700\n",
            "2021/05/25 00:36:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:36:42\tINFO\t__main__\t * Acc@1 92.0500\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:36:42\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.8500 -> 92.0500)\n",
            "2021/05/25 00:36:43\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [  0/391]  eta: 0:05:59  lr: 0.010000000000000002  img/s: 335.2505566996919  loss: 0.2267 (0.2267)  time: 0.9182  data: 0.5364  max mem: 700\n",
            "2021/05/25 00:36:54\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1139.6331324521166  loss: 0.1761 (0.1796)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:37:05\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1141.4139757970559  loss: 0.1925 (0.1827)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:37:17\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1144.1993303652303  loss: 0.1699 (0.1823)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:37:27\tINFO\ttorchdistill.misc.log\tEpoch: [99] Total time: 0:00:45\n",
            "2021/05/25 00:37:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5821  data: 0.5574  max mem: 700\n",
            "2021/05/25 00:37:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:37:29\tINFO\t__main__\t * Acc@1 91.8400\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:37:30\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [  0/391]  eta: 0:06:59  lr: 0.010000000000000002  img/s: 350.9586429474017  loss: 0.2096 (0.2096)  time: 1.0725  data: 0.7078  max mem: 700\n",
            "2021/05/25 00:37:42\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1140.6331122338413  loss: 0.1880 (0.1831)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:37:53\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1147.8787189415596  loss: 0.1833 (0.1821)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:38:04\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.8100035276384  loss: 0.1713 (0.1811)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:38:15\tINFO\ttorchdistill.misc.log\tEpoch: [100] Total time: 0:00:45\n",
            "2021/05/25 00:38:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 91.4062 (91.4062)  acc5: 99.2188 (99.2188)  time: 0.5226  data: 0.4885  max mem: 700\n",
            "2021/05/25 00:38:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:38:17\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:38:18\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [  0/391]  eta: 0:05:28  lr: 0.010000000000000002  img/s: 375.50510376085  loss: 0.2060 (0.2060)  time: 0.8393  data: 0.4984  max mem: 700\n",
            "2021/05/25 00:38:30\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [100/391]  eta: 0:00:35  lr: 0.010000000000000002  img/s: 1149.7962465224757  loss: 0.1746 (0.1753)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:38:41\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1137.0986887391691  loss: 0.1728 (0.1764)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:38:52\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1140.8779264604943  loss: 0.1641 (0.1760)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:39:02\tINFO\ttorchdistill.misc.log\tEpoch: [101] Total time: 0:00:45\n",
            "2021/05/25 00:39:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5583  data: 0.5375  max mem: 700\n",
            "2021/05/25 00:39:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:39:05\tINFO\t__main__\t * Acc@1 91.8200\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:39:06\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [  0/391]  eta: 0:05:47  lr: 0.010000000000000002  img/s: 351.2635849670145  loss: 0.1583 (0.1583)  time: 0.8889  data: 0.5245  max mem: 700\n",
            "2021/05/25 00:39:17\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1143.4365698026086  loss: 0.1579 (0.1690)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:39:29\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1143.0324511912113  loss: 0.1795 (0.1733)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:39:40\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1135.0960348771814  loss: 0.1821 (0.1738)  time: 0.1123  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:39:50\tINFO\ttorchdistill.misc.log\tEpoch: [102] Total time: 0:00:45\n",
            "2021/05/25 00:39:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5432  data: 0.4970  max mem: 700\n",
            "2021/05/25 00:39:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:39:53\tINFO\t__main__\t * Acc@1 92.0800\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:39:53\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.0500 -> 92.0800)\n",
            "2021/05/25 00:39:54\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [  0/391]  eta: 0:07:11  lr: 0.010000000000000002  img/s: 355.3869035246706  loss: 0.1108 (0.1108)  time: 1.1033  data: 0.7431  max mem: 700\n",
            "2021/05/25 00:40:05\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1143.3976061677386  loss: 0.1583 (0.1682)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:40:16\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.6350029768066  loss: 0.1539 (0.1665)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:40:28\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1149.643593318044  loss: 0.1646 (0.1688)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:40:38\tINFO\ttorchdistill.misc.log\tEpoch: [103] Total time: 0:00:45\n",
            "2021/05/25 00:40:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5481  data: 0.5177  max mem: 700\n",
            "2021/05/25 00:40:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:40:40\tINFO\t__main__\t * Acc@1 92.0700\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:40:41\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [  0/391]  eta: 0:06:15  lr: 0.010000000000000002  img/s: 345.6008734152933  loss: 0.1343 (0.1343)  time: 0.9599  data: 0.5895  max mem: 700\n",
            "2021/05/25 00:40:53\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1144.8532380267964  loss: 0.1673 (0.1618)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:41:04\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1137.7300367255166  loss: 0.1562 (0.1643)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:41:15\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1138.7073560790202  loss: 0.1861 (0.1668)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:41:25\tINFO\ttorchdistill.misc.log\tEpoch: [104] Total time: 0:00:45\n",
            "2021/05/25 00:41:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5598  data: 0.5168  max mem: 700\n",
            "2021/05/25 00:41:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:41:28\tINFO\t__main__\t * Acc@1 92.0800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:41:29\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [  0/391]  eta: 0:05:42  lr: 0.010000000000000002  img/s: 342.82703761340116  loss: 0.1502 (0.1502)  time: 0.8754  data: 0.5020  max mem: 700\n",
            "2021/05/25 00:41:40\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [100/391]  eta: 0:00:35  lr: 0.010000000000000002  img/s: 1142.2688147334916  loss: 0.1583 (0.1611)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:41:52\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1137.761381409129  loss: 0.1523 (0.1638)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:42:03\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.2189001145357  loss: 0.1378 (0.1628)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:42:13\tINFO\ttorchdistill.misc.log\tEpoch: [105] Total time: 0:00:45\n",
            "2021/05/25 00:42:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5700  data: 0.5277  max mem: 700\n",
            "2021/05/25 00:42:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:42:16\tINFO\t__main__\t * Acc@1 92.0900\tAcc@5 99.7100\n",
            "\n",
            "2021/05/25 00:42:16\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.0800 -> 92.0900)\n",
            "2021/05/25 00:42:17\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [  0/391]  eta: 0:06:47  lr: 0.010000000000000002  img/s: 330.5938832199581  loss: 0.1461 (0.1461)  time: 1.0416  data: 0.6544  max mem: 700\n",
            "2021/05/25 00:42:28\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1149.7346879336635  loss: 0.1676 (0.1616)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:42:39\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1138.598682131579  loss: 0.1740 (0.1611)  time: 0.1121  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:42:51\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.5867352391701  loss: 0.1556 (0.1610)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:43:01\tINFO\ttorchdistill.misc.log\tEpoch: [106] Total time: 0:00:45\n",
            "2021/05/25 00:43:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5418  data: 0.4983  max mem: 700\n",
            "2021/05/25 00:43:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:43:03\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 00:43:05\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [  0/391]  eta: 0:08:07  lr: 0.010000000000000002  img/s: 364.37652335149545  loss: 0.1544 (0.1544)  time: 1.2471  data: 0.8958  max mem: 700\n",
            "2021/05/25 00:43:16\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1139.5025140880196  loss: 0.1482 (0.1547)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:43:27\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1146.4398689712018  loss: 0.1459 (0.1585)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:43:38\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1125.539134992348  loss: 0.1478 (0.1598)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:43:49\tINFO\ttorchdistill.misc.log\tEpoch: [107] Total time: 0:00:45\n",
            "2021/05/25 00:43:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5683  data: 0.5345  max mem: 700\n",
            "2021/05/25 00:43:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:43:51\tINFO\t__main__\t * Acc@1 92.0300\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:43:52\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [  0/391]  eta: 0:07:14  lr: 0.010000000000000002  img/s: 329.8660876339904  loss: 0.1626 (0.1626)  time: 1.1112  data: 0.7231  max mem: 700\n",
            "2021/05/25 00:44:04\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1147.4959806610054  loss: 0.1589 (0.1554)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:44:15\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1142.4146536608616  loss: 0.1440 (0.1538)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:44:26\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.117633156253  loss: 0.1532 (0.1570)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:44:36\tINFO\ttorchdistill.misc.log\tEpoch: [108] Total time: 0:00:45\n",
            "2021/05/25 00:44:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5959  data: 0.5189  max mem: 700\n",
            "2021/05/25 00:44:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:44:39\tINFO\t__main__\t * Acc@1 92.1100\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:44:39\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.0900 -> 92.1100)\n",
            "2021/05/25 00:44:40\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [  0/391]  eta: 0:05:53  lr: 0.010000000000000002  img/s: 356.33608514829666  loss: 0.1385 (0.1385)  time: 0.9041  data: 0.5449  max mem: 700\n",
            "2021/05/25 00:44:51\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1134.8153146012078  loss: 0.1541 (0.1511)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:45:03\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1146.5206626219137  loss: 0.1503 (0.1567)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:45:14\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.0938898824213  loss: 0.1492 (0.1552)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:45:24\tINFO\ttorchdistill.misc.log\tEpoch: [109] Total time: 0:00:45\n",
            "2021/05/25 00:45:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5364  data: 0.5114  max mem: 700\n",
            "2021/05/25 00:45:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:45:27\tINFO\t__main__\t * Acc@1 92.0000\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 00:45:28\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [  0/391]  eta: 0:07:24  lr: 0.010000000000000002  img/s: 332.8511382278142  loss: 0.1607 (0.1607)  time: 1.1356  data: 0.7510  max mem: 700\n",
            "2021/05/25 00:45:39\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1150.0203754637603  loss: 0.1440 (0.1542)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:45:50\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1148.052998486002  loss: 0.1495 (0.1532)  time: 0.1120  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:46:01\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.375814255672  loss: 0.1349 (0.1523)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:46:12\tINFO\ttorchdistill.misc.log\tEpoch: [110] Total time: 0:00:45\n",
            "2021/05/25 00:46:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5524  data: 0.5247  max mem: 700\n",
            "2021/05/25 00:46:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:46:14\tINFO\t__main__\t * Acc@1 92.1400\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 00:46:14\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.1100 -> 92.1400)\n",
            "2021/05/25 00:46:15\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [  0/391]  eta: 0:06:06  lr: 0.010000000000000002  img/s: 314.56094252697113  loss: 0.1585 (0.1585)  time: 0.9371  data: 0.5301  max mem: 700\n",
            "2021/05/25 00:46:27\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1140.919143148589  loss: 0.1460 (0.1531)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:46:38\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1141.7975235964423  loss: 0.1412 (0.1535)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:46:49\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.8994660518947  loss: 0.1510 (0.1520)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:46:59\tINFO\ttorchdistill.misc.log\tEpoch: [111] Total time: 0:00:45\n",
            "2021/05/25 00:47:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5436  data: 0.5069  max mem: 700\n",
            "2021/05/25 00:47:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:47:02\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:47:03\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [  0/391]  eta: 0:05:43  lr: 0.010000000000000002  img/s: 355.1807073963493  loss: 0.1625 (0.1625)  time: 0.8779  data: 0.5175  max mem: 700\n",
            "2021/05/25 00:47:14\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1134.168028206802  loss: 0.1536 (0.1492)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:47:26\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1148.6818263511489  loss: 0.1475 (0.1520)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:47:37\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1144.7360652976283  loss: 0.1451 (0.1503)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:47:47\tINFO\ttorchdistill.misc.log\tEpoch: [112] Total time: 0:00:45\n",
            "2021/05/25 00:47:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:52  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6616  data: 0.6261  max mem: 700\n",
            "2021/05/25 00:47:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:47:50\tINFO\t__main__\t * Acc@1 91.9200\tAcc@5 99.7000\n",
            "\n",
            "2021/05/25 00:47:51\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [  0/391]  eta: 0:07:10  lr: 0.010000000000000002  img/s: 355.41984182993207  loss: 0.1489 (0.1489)  time: 1.1009  data: 0.7408  max mem: 700\n",
            "2021/05/25 00:48:02\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1147.4027881966485  loss: 0.1430 (0.1476)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:48:13\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1141.9748194629087  loss: 0.1324 (0.1475)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:48:25\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1149.426993836134  loss: 0.1339 (0.1491)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:48:35\tINFO\ttorchdistill.misc.log\tEpoch: [113] Total time: 0:00:45\n",
            "2021/05/25 00:48:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5521  data: 0.5227  max mem: 700\n",
            "2021/05/25 00:48:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:48:37\tINFO\t__main__\t * Acc@1 92.1800\tAcc@5 99.7000\n",
            "\n",
            "2021/05/25 00:48:37\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.1400 -> 92.1800)\n",
            "2021/05/25 00:48:38\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [  0/391]  eta: 0:05:40  lr: 0.010000000000000002  img/s: 374.96196189274906  loss: 0.1343 (0.1343)  time: 0.8697  data: 0.5283  max mem: 700\n",
            "2021/05/25 00:48:50\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [100/391]  eta: 0:00:35  lr: 0.010000000000000002  img/s: 1142.638345691835  loss: 0.1412 (0.1464)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:49:01\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.8898594240482  loss: 0.1467 (0.1475)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:49:12\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1148.048088478695  loss: 0.1427 (0.1472)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:49:23\tINFO\ttorchdistill.misc.log\tEpoch: [114] Total time: 0:00:45\n",
            "2021/05/25 00:49:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5632  data: 0.5333  max mem: 700\n",
            "2021/05/25 00:49:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:49:25\tINFO\t__main__\t * Acc@1 92.1200\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:49:26\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [  0/391]  eta: 0:06:18  lr: 0.010000000000000002  img/s: 322.9407498839059  loss: 0.2031 (0.2031)  time: 0.9668  data: 0.5704  max mem: 700\n",
            "2021/05/25 00:49:38\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1139.5678195271673  loss: 0.1402 (0.1450)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:49:49\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1141.117994890303  loss: 0.1417 (0.1451)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:50:00\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1144.9191582287658  loss: 0.1518 (0.1471)  time: 0.1127  data: 0.0007  max mem: 700\n",
            "2021/05/25 00:50:10\tINFO\ttorchdistill.misc.log\tEpoch: [115] Total time: 0:00:45\n",
            "2021/05/25 00:50:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.6138  data: 0.5825  max mem: 700\n",
            "2021/05/25 00:50:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:50:13\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:50:14\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [  0/391]  eta: 0:08:10  lr: 0.010000000000000002  img/s: 361.1831302395079  loss: 0.1113 (0.1113)  time: 1.2554  data: 0.9010  max mem: 700\n",
            "2021/05/25 00:50:26\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1146.8807000004272  loss: 0.1416 (0.1442)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:50:37\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1146.4447652319493  loss: 0.1492 (0.1454)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:50:48\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1139.548468987065  loss: 0.1394 (0.1457)  time: 0.1121  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:50:58\tINFO\ttorchdistill.misc.log\tEpoch: [116] Total time: 0:00:45\n",
            "2021/05/25 00:50:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5465  data: 0.5068  max mem: 700\n",
            "2021/05/25 00:51:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:51:01\tINFO\t__main__\t * Acc@1 92.2500\tAcc@5 99.7800\n",
            "\n",
            "2021/05/25 00:51:01\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.1800 -> 92.2500)\n",
            "2021/05/25 00:51:02\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [  0/391]  eta: 0:07:21  lr: 0.010000000000000002  img/s: 300.5232219805268  loss: 0.1479 (0.1479)  time: 1.1293  data: 0.7033  max mem: 700\n",
            "2021/05/25 00:51:14\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1165.4334674880931  loss: 0.1433 (0.1439)  time: 0.1128  data: 0.0005  max mem: 700\n",
            "2021/05/25 00:51:25\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.6496712667274  loss: 0.1379 (0.1432)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:51:36\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1148.866183755791  loss: 0.1277 (0.1438)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:51:46\tINFO\ttorchdistill.misc.log\tEpoch: [117] Total time: 0:00:45\n",
            "2021/05/25 00:51:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5729  data: 0.5211  max mem: 700\n",
            "2021/05/25 00:51:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:51:49\tINFO\t__main__\t * Acc@1 92.2200\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:51:50\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [  0/391]  eta: 0:07:36  lr: 0.010000000000000002  img/s: 325.69509671587645  loss: 0.1481 (0.1481)  time: 1.1668  data: 0.7738  max mem: 700\n",
            "2021/05/25 00:52:01\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1137.7589702183031  loss: 0.1335 (0.1380)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:52:13\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.6130012461804  loss: 0.1325 (0.1395)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:52:24\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1141.4746465786861  loss: 0.1332 (0.1407)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:52:34\tINFO\ttorchdistill.misc.log\tEpoch: [118] Total time: 0:00:45\n",
            "2021/05/25 00:52:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5925  data: 0.5829  max mem: 700\n",
            "2021/05/25 00:52:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:52:36\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 00:52:38\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [  0/391]  eta: 0:07:03  lr: 0.010000000000000002  img/s: 352.5518625386948  loss: 0.1580 (0.1580)  time: 1.0825  data: 0.7194  max mem: 700\n",
            "2021/05/25 00:52:49\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1143.490149136745  loss: 0.1416 (0.1376)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:53:00\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1142.1375915312578  loss: 0.1410 (0.1390)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:53:11\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1137.5516460325498  loss: 0.1349 (0.1388)  time: 0.1132  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:53:22\tINFO\ttorchdistill.misc.log\tEpoch: [119] Total time: 0:00:45\n",
            "2021/05/25 00:53:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.6560  data: 0.6163  max mem: 700\n",
            "2021/05/25 00:53:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:53:25\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7800\n",
            "\n",
            "2021/05/25 00:53:26\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [  0/391]  eta: 0:09:16  lr: 0.010000000000000002  img/s: 322.778627037316  loss: 0.1579 (0.1579)  time: 1.4225  data: 1.0260  max mem: 700\n",
            "2021/05/25 00:53:37\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1141.872806896273  loss: 0.1422 (0.1441)  time: 0.1131  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:53:49\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.9944842425225  loss: 0.1414 (0.1423)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:54:00\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1138.8257135281328  loss: 0.1411 (0.1403)  time: 0.1124  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:54:10\tINFO\ttorchdistill.misc.log\tEpoch: [120] Total time: 0:00:45\n",
            "2021/05/25 00:54:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5541  data: 0.5148  max mem: 700\n",
            "2021/05/25 00:54:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:54:13\tINFO\t__main__\t * Acc@1 92.2700\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 00:54:13\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.2500 -> 92.2700)\n",
            "2021/05/25 00:54:14\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [  0/391]  eta: 0:06:54  lr: 0.010000000000000002  img/s: 335.89217833719044  loss: 0.1356 (0.1356)  time: 1.0588  data: 0.6777  max mem: 700\n",
            "2021/05/25 00:54:25\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1139.3453279853993  loss: 0.1421 (0.1388)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:54:36\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.2651752830445  loss: 0.1267 (0.1375)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:54:48\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1135.9750829440043  loss: 0.1334 (0.1377)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:54:58\tINFO\ttorchdistill.misc.log\tEpoch: [121] Total time: 0:00:45\n",
            "2021/05/25 00:54:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5815  data: 0.5318  max mem: 700\n",
            "2021/05/25 00:55:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:55:00\tINFO\t__main__\t * Acc@1 92.2600\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 00:55:01\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [  0/391]  eta: 0:06:09  lr: 0.010000000000000002  img/s: 333.1400896157543  loss: 0.1079 (0.1079)  time: 0.9442  data: 0.5599  max mem: 700\n",
            "2021/05/25 00:55:13\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1140.8633801051037  loss: 0.1191 (0.1302)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:55:24\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.2724918528245  loss: 0.1469 (0.1353)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:55:35\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1148.7506461938754  loss: 0.1397 (0.1367)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:55:46\tINFO\ttorchdistill.misc.log\tEpoch: [122] Total time: 0:00:45\n",
            "2021/05/25 00:55:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6225  data: 0.5749  max mem: 700\n",
            "2021/05/25 00:55:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:55:48\tINFO\t__main__\t * Acc@1 91.9000\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 00:55:49\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [  0/391]  eta: 0:06:07  lr: 0.010000000000000002  img/s: 308.90031628181015  loss: 0.1182 (0.1182)  time: 0.9394  data: 0.5250  max mem: 700\n",
            "2021/05/25 00:56:01\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1143.4463111262567  loss: 0.1268 (0.1356)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:56:12\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1138.688034750001  loss: 0.1464 (0.1368)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:56:23\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1145.7156832198723  loss: 0.1439 (0.1384)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:56:34\tINFO\ttorchdistill.misc.log\tEpoch: [123] Total time: 0:00:45\n",
            "2021/05/25 00:56:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5734  data: 0.5393  max mem: 700\n",
            "2021/05/25 00:56:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:56:36\tINFO\t__main__\t * Acc@1 92.1700\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:56:37\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [  0/391]  eta: 0:07:50  lr: 0.010000000000000002  img/s: 315.13943547714894  loss: 0.1057 (0.1057)  time: 1.2028  data: 0.7966  max mem: 700\n",
            "2021/05/25 00:56:49\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1142.9302495891275  loss: 0.1284 (0.1335)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:57:00\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1144.2578588068297  loss: 0.1377 (0.1354)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:57:11\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1139.1615961433185  loss: 0.1333 (0.1362)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:57:22\tINFO\ttorchdistill.misc.log\tEpoch: [124] Total time: 0:00:45\n",
            "2021/05/25 00:57:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5429  data: 0.4900  max mem: 700\n",
            "2021/05/25 00:57:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:57:24\tINFO\t__main__\t * Acc@1 92.4100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:57:24\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.2700 -> 92.4100)\n",
            "2021/05/25 00:57:25\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [  0/391]  eta: 0:07:02  lr: 0.010000000000000002  img/s: 345.8640382410163  loss: 0.1190 (0.1190)  time: 1.0797  data: 0.7096  max mem: 700\n",
            "2021/05/25 00:57:37\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1145.8355021225464  loss: 0.1218 (0.1291)  time: 0.1131  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:57:48\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1151.747369866305  loss: 0.1284 (0.1308)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:57:59\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1146.3884607582504  loss: 0.1283 (0.1328)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:58:09\tINFO\ttorchdistill.misc.log\tEpoch: [125] Total time: 0:00:45\n",
            "2021/05/25 00:58:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5267  data: 0.5021  max mem: 700\n",
            "2021/05/25 00:58:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:58:12\tINFO\t__main__\t * Acc@1 92.3500\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 00:58:13\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [  0/391]  eta: 0:07:21  lr: 0.010000000000000002  img/s: 323.8020436399517  loss: 0.0998 (0.0998)  time: 1.1285  data: 0.7332  max mem: 700\n",
            "2021/05/25 00:58:25\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1134.9256666913295  loss: 0.1308 (0.1270)  time: 0.1127  data: 0.0003  max mem: 700\n",
            "2021/05/25 00:58:36\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1132.223428530455  loss: 0.1296 (0.1294)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:58:47\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1134.5467209633075  loss: 0.1215 (0.1305)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:58:57\tINFO\ttorchdistill.misc.log\tEpoch: [126] Total time: 0:00:45\n",
            "2021/05/25 00:58:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5516  data: 0.5086  max mem: 700\n",
            "2021/05/25 00:59:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:59:00\tINFO\t__main__\t * Acc@1 92.3000\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:59:01\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [  0/391]  eta: 0:06:05  lr: 0.010000000000000002  img/s: 303.1069507787262  loss: 0.1300 (0.1300)  time: 0.9348  data: 0.5125  max mem: 700\n",
            "2021/05/25 00:59:12\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1140.5119559490831  loss: 0.1385 (0.1364)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:59:24\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1134.64503066603  loss: 0.1297 (0.1327)  time: 0.1131  data: 0.0002  max mem: 700\n",
            "2021/05/25 00:59:35\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.77274141112  loss: 0.1487 (0.1344)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 00:59:45\tINFO\ttorchdistill.misc.log\tEpoch: [127] Total time: 0:00:45\n",
            "2021/05/25 00:59:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5388  data: 0.4897  max mem: 700\n",
            "2021/05/25 00:59:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 00:59:48\tINFO\t__main__\t * Acc@1 92.1100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 00:59:49\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [  0/391]  eta: 0:07:57  lr: 0.010000000000000002  img/s: 319.70874616644335  loss: 0.1123 (0.1123)  time: 1.2221  data: 0.8217  max mem: 700\n",
            "2021/05/25 01:00:00\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1134.1824043265626  loss: 0.1203 (0.1323)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:00:12\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1141.1980401534718  loss: 0.1203 (0.1320)  time: 0.1123  data: 0.0005  max mem: 700\n",
            "2021/05/25 01:00:23\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1144.7165388412343  loss: 0.1323 (0.1322)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:00:33\tINFO\ttorchdistill.misc.log\tEpoch: [128] Total time: 0:00:45\n",
            "2021/05/25 01:00:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5610  data: 0.5315  max mem: 700\n",
            "2021/05/25 01:00:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:00:36\tINFO\t__main__\t * Acc@1 92.2800\tAcc@5 99.7800\n",
            "\n",
            "2021/05/25 01:00:37\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [  0/391]  eta: 0:06:33  lr: 0.010000000000000002  img/s: 315.6795899059378  loss: 0.1070 (0.1070)  time: 1.0071  data: 0.6016  max mem: 700\n",
            "2021/05/25 01:00:48\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1141.1446753969992  loss: 0.1267 (0.1265)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:00:59\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1143.7703046739684  loss: 0.1324 (0.1282)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:01:11\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.872656574588  loss: 0.1240 (0.1291)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:01:21\tINFO\ttorchdistill.misc.log\tEpoch: [129] Total time: 0:00:45\n",
            "2021/05/25 01:01:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6278  data: 0.6092  max mem: 700\n",
            "2021/05/25 01:01:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:01:23\tINFO\t__main__\t * Acc@1 92.1600\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:01:24\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [  0/391]  eta: 0:06:39  lr: 0.010000000000000002  img/s: 343.1215153128429  loss: 0.1301 (0.1301)  time: 1.0219  data: 0.6488  max mem: 700\n",
            "2021/05/25 01:01:36\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1138.2800248488818  loss: 0.1323 (0.1281)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:01:47\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1138.4610582387568  loss: 0.1085 (0.1271)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:01:58\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1137.831310388969  loss: 0.1141 (0.1278)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:02:09\tINFO\ttorchdistill.misc.log\tEpoch: [130] Total time: 0:00:45\n",
            "2021/05/25 01:02:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5532  data: 0.5197  max mem: 700\n",
            "2021/05/25 01:02:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:02:11\tINFO\t__main__\t * Acc@1 92.1100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:02:12\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [  0/391]  eta: 0:06:05  lr: 0.010000000000000002  img/s: 352.3355303268452  loss: 0.1257 (0.1257)  time: 0.9346  data: 0.5713  max mem: 700\n",
            "2021/05/25 01:02:24\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1142.925383302039  loss: 0.1106 (0.1252)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:02:35\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1139.8533163481952  loss: 0.1266 (0.1277)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:02:46\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.1127652733803  loss: 0.1348 (0.1288)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:02:57\tINFO\ttorchdistill.misc.log\tEpoch: [131] Total time: 0:00:45\n",
            "2021/05/25 01:02:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6144  data: 0.5746  max mem: 700\n",
            "2021/05/25 01:02:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:02:59\tINFO\t__main__\t * Acc@1 92.1200\tAcc@5 99.7900\n",
            "\n",
            "2021/05/25 01:03:00\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [  0/391]  eta: 0:05:54  lr: 0.010000000000000002  img/s: 321.85579311866326  loss: 0.1291 (0.1291)  time: 0.9078  data: 0.5101  max mem: 700\n",
            "2021/05/25 01:03:12\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1152.0043945480138  loss: 0.1270 (0.1290)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:03:23\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1137.76620382144  loss: 0.1124 (0.1270)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:03:34\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1143.3075129318515  loss: 0.1226 (0.1277)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:03:44\tINFO\ttorchdistill.misc.log\tEpoch: [132] Total time: 0:00:45\n",
            "2021/05/25 01:03:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5530  data: 0.5028  max mem: 700\n",
            "2021/05/25 01:03:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:03:47\tINFO\t__main__\t * Acc@1 92.1000\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:03:48\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [  0/391]  eta: 0:07:15  lr: 0.010000000000000002  img/s: 318.8643277264258  loss: 0.0894 (0.0894)  time: 1.1135  data: 0.7121  max mem: 700\n",
            "2021/05/25 01:03:59\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1142.1497405611708  loss: 0.1280 (0.1269)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:04:11\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1145.5738891449446  loss: 0.1276 (0.1273)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:04:22\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1146.3003431187294  loss: 0.1290 (0.1272)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:04:32\tINFO\ttorchdistill.misc.log\tEpoch: [133] Total time: 0:00:45\n",
            "2021/05/25 01:04:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5211  data: 0.4957  max mem: 700\n",
            "2021/05/25 01:04:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:04:35\tINFO\t__main__\t * Acc@1 92.1100\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 01:04:35\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [  0/391]  eta: 0:05:35  lr: 0.010000000000000002  img/s: 369.26972388215745  loss: 0.1236 (0.1236)  time: 0.8581  data: 0.5115  max mem: 700\n",
            "2021/05/25 01:04:47\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [100/391]  eta: 0:00:35  lr: 0.010000000000000002  img/s: 1141.3654438151607  loss: 0.1177 (0.1228)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:04:58\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1147.2532214154141  loss: 0.1208 (0.1258)  time: 0.1125  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:05:09\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1141.588725110784  loss: 0.1175 (0.1250)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:05:20\tINFO\ttorchdistill.misc.log\tEpoch: [134] Total time: 0:00:45\n",
            "2021/05/25 01:05:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5743  data: 0.5442  max mem: 700\n",
            "2021/05/25 01:05:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:05:22\tINFO\t__main__\t * Acc@1 92.2500\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:05:23\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [  0/391]  eta: 0:06:57  lr: 0.010000000000000002  img/s: 358.72825447098245  loss: 0.1002 (0.1002)  time: 1.0685  data: 0.7117  max mem: 700\n",
            "2021/05/25 01:05:35\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [100/391]  eta: 0:00:36  lr: 0.010000000000000002  img/s: 1138.3355356340167  loss: 0.1136 (0.1289)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:05:46\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [200/391]  eta: 0:00:22  lr: 0.010000000000000002  img/s: 1135.607446468723  loss: 0.1167 (0.1270)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:05:57\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [300/391]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 1147.6799575876253  loss: 0.1218 (0.1256)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:06:08\tINFO\ttorchdistill.misc.log\tEpoch: [135] Total time: 0:00:45\n",
            "2021/05/25 01:06:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5763  data: 0.5143  max mem: 700\n",
            "2021/05/25 01:06:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:06:10\tINFO\t__main__\t * Acc@1 92.1000\tAcc@5 99.7100\n",
            "\n",
            "2021/05/25 01:06:11\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [  0/391]  eta: 0:07:22  lr: 0.0010000000000000002  img/s: 309.91243128478334  loss: 0.1281 (0.1281)  time: 1.1315  data: 0.7184  max mem: 700\n",
            "2021/05/25 01:06:23\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1146.6063653022259  loss: 0.1199 (0.1218)  time: 0.1126  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:06:34\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.0760063536827  loss: 0.1044 (0.1213)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:06:45\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1144.3871303295007  loss: 0.1227 (0.1209)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:06:55\tINFO\ttorchdistill.misc.log\tEpoch: [136] Total time: 0:00:45\n",
            "2021/05/25 01:06:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6194  data: 0.5517  max mem: 700\n",
            "2021/05/25 01:06:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:06:58\tINFO\t__main__\t * Acc@1 92.3200\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:06:59\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [  0/391]  eta: 0:07:35  lr: 0.0010000000000000002  img/s: 327.11916154493423  loss: 0.1183 (0.1183)  time: 1.1640  data: 0.7726  max mem: 700\n",
            "2021/05/25 01:07:10\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1146.0850014623036  loss: 0.1060 (0.1186)  time: 0.1118  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:07:22\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.2212778291653  loss: 0.1169 (0.1192)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:07:33\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1140.080848407113  loss: 0.1063 (0.1180)  time: 0.1126  data: 0.0005  max mem: 700\n",
            "2021/05/25 01:07:43\tINFO\ttorchdistill.misc.log\tEpoch: [137] Total time: 0:00:45\n",
            "2021/05/25 01:07:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:55  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.7019  data: 0.6787  max mem: 700\n",
            "2021/05/25 01:07:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:07:46\tINFO\t__main__\t * Acc@1 92.2700\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:07:46\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [  0/391]  eta: 0:05:59  lr: 0.0010000000000000002  img/s: 309.1169462726906  loss: 0.1030 (0.1030)  time: 0.9197  data: 0.5055  max mem: 700\n",
            "2021/05/25 01:07:58\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1141.8363782535273  loss: 0.1216 (0.1233)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:08:09\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1141.74410276041  loss: 0.1144 (0.1225)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:08:21\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1142.3757596391183  loss: 0.1077 (0.1202)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:08:31\tINFO\ttorchdistill.misc.log\tEpoch: [138] Total time: 0:00:45\n",
            "2021/05/25 01:08:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5597  data: 0.5272  max mem: 700\n",
            "2021/05/25 01:08:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:08:33\tINFO\t__main__\t * Acc@1 92.3500\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 01:08:34\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [  0/391]  eta: 0:05:41  lr: 0.0010000000000000002  img/s: 345.74242500350977  loss: 0.1141 (0.1141)  time: 0.8734  data: 0.5031  max mem: 700\n",
            "2021/05/25 01:08:46\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1138.1086996154515  loss: 0.1107 (0.1142)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:08:57\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1147.3782663797176  loss: 0.1079 (0.1157)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:09:08\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1148.5442114000634  loss: 0.1149 (0.1170)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:09:18\tINFO\ttorchdistill.misc.log\tEpoch: [139] Total time: 0:00:45\n",
            "2021/05/25 01:09:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5379  data: 0.4921  max mem: 700\n",
            "2021/05/25 01:09:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:09:21\tINFO\t__main__\t * Acc@1 92.2900\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:09:22\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [  0/391]  eta: 0:08:05  lr: 0.0010000000000000002  img/s: 334.63974693406885  loss: 0.1170 (0.1170)  time: 1.2414  data: 0.8589  max mem: 700\n",
            "2021/05/25 01:09:34\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.8888874696913  loss: 0.1077 (0.1134)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:09:45\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.7494464866243  loss: 0.1190 (0.1143)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:09:56\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1134.5946747875557  loss: 0.1156 (0.1144)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:10:06\tINFO\ttorchdistill.misc.log\tEpoch: [140] Total time: 0:00:45\n",
            "2021/05/25 01:10:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6154  data: 0.5880  max mem: 700\n",
            "2021/05/25 01:10:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:10:09\tINFO\t__main__\t * Acc@1 92.4600\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:10:09\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.4100 -> 92.4600)\n",
            "2021/05/25 01:10:10\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [  0/391]  eta: 0:06:14  lr: 0.0010000000000000002  img/s: 306.9061407420111  loss: 0.1058 (0.1058)  time: 0.9589  data: 0.5418  max mem: 700\n",
            "2021/05/25 01:10:21\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1137.2022588530347  loss: 0.1124 (0.1160)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:10:33\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.5383906948186  loss: 0.1039 (0.1157)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:10:44\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1141.6057174813993  loss: 0.1154 (0.1159)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:10:54\tINFO\ttorchdistill.misc.log\tEpoch: [141] Total time: 0:00:45\n",
            "2021/05/25 01:10:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5515  data: 0.5097  max mem: 700\n",
            "2021/05/25 01:10:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:10:56\tINFO\t__main__\t * Acc@1 92.3000\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:10:57\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [  0/391]  eta: 0:06:21  lr: 0.0010000000000000002  img/s: 339.352491237607  loss: 0.1050 (0.1050)  time: 0.9753  data: 0.5981  max mem: 700\n",
            "2021/05/25 01:11:09\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1144.9777603371351  loss: 0.1172 (0.1191)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:11:20\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1143.546169264227  loss: 0.1201 (0.1184)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:11:31\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.0543539125492  loss: 0.1141 (0.1170)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:11:42\tINFO\ttorchdistill.misc.log\tEpoch: [142] Total time: 0:00:45\n",
            "2021/05/25 01:11:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5667  data: 0.5196  max mem: 700\n",
            "2021/05/25 01:11:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:11:44\tINFO\t__main__\t * Acc@1 92.3300\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:11:45\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [  0/391]  eta: 0:06:26  lr: 0.0010000000000000002  img/s: 307.7650608971015  loss: 0.0708 (0.0708)  time: 0.9889  data: 0.5730  max mem: 700\n",
            "2021/05/25 01:11:57\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1143.3513403001539  loss: 0.1114 (0.1167)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:12:08\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1149.7346879336635  loss: 0.1134 (0.1162)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:12:19\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1146.3860128631095  loss: 0.1162 (0.1164)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:12:30\tINFO\ttorchdistill.misc.log\tEpoch: [143] Total time: 0:00:45\n",
            "2021/05/25 01:12:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5943  data: 0.5538  max mem: 700\n",
            "2021/05/25 01:12:32\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:12:32\tINFO\t__main__\t * Acc@1 92.3700\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:12:33\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [  0/391]  eta: 0:07:27  lr: 0.0010000000000000002  img/s: 336.4550617953974  loss: 0.0971 (0.0971)  time: 1.1456  data: 0.7651  max mem: 700\n",
            "2021/05/25 01:12:45\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1145.8966438712873  loss: 0.1125 (0.1190)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:12:56\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.379812293637  loss: 0.1113 (0.1178)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:13:07\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1142.5726878621942  loss: 0.1205 (0.1176)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:13:17\tINFO\ttorchdistill.misc.log\tEpoch: [144] Total time: 0:00:45\n",
            "2021/05/25 01:13:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5604  data: 0.5234  max mem: 700\n",
            "2021/05/25 01:13:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:13:20\tINFO\t__main__\t * Acc@1 92.4100\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:13:21\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [  0/391]  eta: 0:06:16  lr: 0.0010000000000000002  img/s: 356.80262010591014  loss: 0.1086 (0.1086)  time: 0.9618  data: 0.6030  max mem: 700\n",
            "2021/05/25 01:13:32\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1145.8330565883102  loss: 0.1266 (0.1181)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:13:44\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1146.1657451014719  loss: 0.1073 (0.1170)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:13:55\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1142.195909232098  loss: 0.1115 (0.1164)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:14:05\tINFO\ttorchdistill.misc.log\tEpoch: [145] Total time: 0:00:45\n",
            "2021/05/25 01:14:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:39  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5030  data: 0.4639  max mem: 700\n",
            "2021/05/25 01:14:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:14:08\tINFO\t__main__\t * Acc@1 92.2100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:14:09\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [  0/391]  eta: 0:06:42  lr: 0.0010000000000000002  img/s: 329.0696686017183  loss: 0.1067 (0.1067)  time: 1.0286  data: 0.6396  max mem: 700\n",
            "2021/05/25 01:14:20\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1141.236854020479  loss: 0.1095 (0.1163)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:14:31\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1137.9229544784962  loss: 0.1096 (0.1151)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:14:43\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1145.287963051849  loss: 0.1068 (0.1141)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:14:53\tINFO\ttorchdistill.misc.log\tEpoch: [146] Total time: 0:00:45\n",
            "2021/05/25 01:14:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5826  data: 0.5255  max mem: 700\n",
            "2021/05/25 01:14:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:14:55\tINFO\t__main__\t * Acc@1 92.4400\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:14:57\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [  0/391]  eta: 0:07:59  lr: 0.0010000000000000002  img/s: 334.3912970090008  loss: 0.0947 (0.0947)  time: 1.2271  data: 0.8443  max mem: 700\n",
            "2021/05/25 01:15:08\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1145.982253282417  loss: 0.1170 (0.1112)  time: 0.1128  data: 0.0005  max mem: 700\n",
            "2021/05/25 01:15:19\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.309076105259  loss: 0.1122 (0.1130)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:15:30\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.178485190469  loss: 0.1029 (0.1130)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:15:41\tINFO\ttorchdistill.misc.log\tEpoch: [147] Total time: 0:00:45\n",
            "2021/05/25 01:15:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5972  data: 0.5790  max mem: 700\n",
            "2021/05/25 01:15:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:15:43\tINFO\t__main__\t * Acc@1 92.3700\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:15:44\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [  0/391]  eta: 0:07:06  lr: 0.0010000000000000002  img/s: 319.78168133628213  loss: 0.1249 (0.1249)  time: 1.0907  data: 0.6904  max mem: 700\n",
            "2021/05/25 01:15:56\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1139.4517261432277  loss: 0.1188 (0.1140)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:16:07\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1142.2906881988106  loss: 0.1082 (0.1160)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:16:18\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1138.5045148210825  loss: 0.1095 (0.1145)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:16:28\tINFO\ttorchdistill.misc.log\tEpoch: [148] Total time: 0:00:45\n",
            "2021/05/25 01:16:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5851  data: 0.5469  max mem: 700\n",
            "2021/05/25 01:16:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:16:31\tINFO\t__main__\t * Acc@1 92.2300\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:16:32\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [  0/391]  eta: 0:07:22  lr: 0.0010000000000000002  img/s: 319.545096452018  loss: 0.1126 (0.1126)  time: 1.1317  data: 0.7311  max mem: 700\n",
            "2021/05/25 01:16:43\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1153.417605341801  loss: 0.1074 (0.1141)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:16:55\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1147.9818074904044  loss: 0.1145 (0.1144)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:17:06\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1152.5756964884147  loss: 0.1085 (0.1140)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:17:16\tINFO\ttorchdistill.misc.log\tEpoch: [149] Total time: 0:00:45\n",
            "2021/05/25 01:17:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5668  data: 0.5438  max mem: 700\n",
            "2021/05/25 01:17:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:17:19\tINFO\t__main__\t * Acc@1 92.2600\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:17:19\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [  0/391]  eta: 0:05:43  lr: 0.0010000000000000002  img/s: 382.5406320919743  loss: 0.0973 (0.0973)  time: 0.8776  data: 0.5430  max mem: 700\n",
            "2021/05/25 01:17:31\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1150.5182048457677  loss: 0.1139 (0.1174)  time: 0.1122  data: 0.0005  max mem: 700\n",
            "2021/05/25 01:17:42\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1118.8283696397423  loss: 0.1163 (0.1164)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:17:53\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.633863962185  loss: 0.1127 (0.1153)  time: 0.1119  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:18:04\tINFO\ttorchdistill.misc.log\tEpoch: [150] Total time: 0:00:45\n",
            "2021/05/25 01:18:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5865  data: 0.5637  max mem: 700\n",
            "2021/05/25 01:18:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:18:06\tINFO\t__main__\t * Acc@1 92.2900\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:18:07\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [  0/391]  eta: 0:06:38  lr: 0.0010000000000000002  img/s: 344.9604465902388  loss: 0.1052 (0.1052)  time: 1.0195  data: 0.6484  max mem: 700\n",
            "2021/05/25 01:18:19\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.1594599711946  loss: 0.1113 (0.1140)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:18:30\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.490150551157  loss: 0.1214 (0.1168)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:18:41\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.193090642727  loss: 0.1137 (0.1176)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:18:52\tINFO\ttorchdistill.misc.log\tEpoch: [151] Total time: 0:00:45\n",
            "2021/05/25 01:18:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6557  data: 0.6213  max mem: 700\n",
            "2021/05/25 01:18:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:18:54\tINFO\t__main__\t * Acc@1 92.3800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:18:55\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [  0/391]  eta: 0:05:53  lr: 0.0010000000000000002  img/s: 353.3949621539501  loss: 0.1260 (0.1260)  time: 0.9032  data: 0.5409  max mem: 700\n",
            "2021/05/25 01:19:07\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1147.8271816098245  loss: 0.1099 (0.1140)  time: 0.1127  data: 0.0003  max mem: 700\n",
            "2021/05/25 01:19:18\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1143.1614459678433  loss: 0.1063 (0.1121)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:19:29\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1136.8988276750017  loss: 0.1095 (0.1131)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:19:39\tINFO\ttorchdistill.misc.log\tEpoch: [152] Total time: 0:00:45\n",
            "2021/05/25 01:19:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5412  data: 0.5168  max mem: 700\n",
            "2021/05/25 01:19:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:19:42\tINFO\t__main__\t * Acc@1 92.3600\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:19:43\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [  0/391]  eta: 0:07:26  lr: 0.0010000000000000002  img/s: 327.47053398460946  loss: 0.1077 (0.1077)  time: 1.1407  data: 0.7498  max mem: 700\n",
            "2021/05/25 01:19:54\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1149.24491652592  loss: 0.1169 (0.1145)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:20:06\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1143.6021948808834  loss: 0.1118 (0.1129)  time: 0.1118  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:20:17\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1139.3453279853993  loss: 0.1205 (0.1138)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:20:27\tINFO\ttorchdistill.misc.log\tEpoch: [153] Total time: 0:00:45\n",
            "2021/05/25 01:20:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5812  data: 0.5243  max mem: 700\n",
            "2021/05/25 01:20:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:20:30\tINFO\t__main__\t * Acc@1 92.4000\tAcc@5 99.7700\n",
            "\n",
            "2021/05/25 01:20:31\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [  0/391]  eta: 0:07:15  lr: 0.0010000000000000002  img/s: 341.06228138495686  loss: 0.1098 (0.1098)  time: 1.1145  data: 0.7391  max mem: 700\n",
            "2021/05/25 01:20:42\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1139.8315361277598  loss: 0.1165 (0.1132)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:20:53\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1145.7596954150056  loss: 0.0970 (0.1133)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:21:05\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1150.0351562667352  loss: 0.1121 (0.1141)  time: 0.1118  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:21:15\tINFO\ttorchdistill.misc.log\tEpoch: [154] Total time: 0:00:45\n",
            "2021/05/25 01:21:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5157  data: 0.4910  max mem: 700\n",
            "2021/05/25 01:21:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:21:17\tINFO\t__main__\t * Acc@1 92.4100\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:21:18\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [  0/391]  eta: 0:07:01  lr: 0.0010000000000000002  img/s: 315.2823083509413  loss: 0.0937 (0.0937)  time: 1.0787  data: 0.6727  max mem: 700\n",
            "2021/05/25 01:21:30\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1143.9774644045838  loss: 0.1250 (0.1144)  time: 0.1132  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:21:41\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1147.8468143333619  loss: 0.1024 (0.1137)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:21:52\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1151.3546403028126  loss: 0.1149 (0.1159)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:22:03\tINFO\ttorchdistill.misc.log\tEpoch: [155] Total time: 0:00:45\n",
            "2021/05/25 01:22:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5768  data: 0.5367  max mem: 700\n",
            "2021/05/25 01:22:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:22:05\tINFO\t__main__\t * Acc@1 92.4100\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:22:06\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [  0/391]  eta: 0:07:45  lr: 0.0010000000000000002  img/s: 329.0325599924004  loss: 0.1010 (0.1010)  time: 1.1907  data: 0.8016  max mem: 700\n",
            "2021/05/25 01:22:18\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1141.3217685599732  loss: 0.1058 (0.1162)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:22:29\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.4212824010915  loss: 0.1201 (0.1155)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:22:40\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1149.7149905773513  loss: 0.1075 (0.1148)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:22:50\tINFO\ttorchdistill.misc.log\tEpoch: [156] Total time: 0:00:45\n",
            "2021/05/25 01:22:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:01:00  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.7657  data: 0.7374  max mem: 700\n",
            "2021/05/25 01:22:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:22:53\tINFO\t__main__\t * Acc@1 92.2900\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 01:22:54\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [  0/391]  eta: 0:07:05  lr: 0.0010000000000000002  img/s: 321.68434878009174  loss: 0.0999 (0.0999)  time: 1.0872  data: 0.6892  max mem: 700\n",
            "2021/05/25 01:23:06\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1145.7596954150056  loss: 0.1134 (0.1140)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:23:17\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1145.989591827151  loss: 0.1118 (0.1151)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:23:28\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1144.9606674358445  loss: 0.1132 (0.1141)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:23:38\tINFO\ttorchdistill.misc.log\tEpoch: [157] Total time: 0:00:45\n",
            "2021/05/25 01:23:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5525  data: 0.5128  max mem: 700\n",
            "2021/05/25 01:23:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:23:41\tINFO\t__main__\t * Acc@1 92.3200\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:23:42\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [  0/391]  eta: 0:06:20  lr: 0.0010000000000000002  img/s: 326.1963481528108  loss: 0.1177 (0.1177)  time: 0.9733  data: 0.5809  max mem: 700\n",
            "2021/05/25 01:23:53\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1146.542699230329  loss: 0.1079 (0.1189)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:24:04\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1145.505449393611  loss: 0.0995 (0.1157)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:24:16\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1146.361534486661  loss: 0.1136 (0.1154)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:24:26\tINFO\ttorchdistill.misc.log\tEpoch: [158] Total time: 0:00:45\n",
            "2021/05/25 01:24:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5989  data: 0.5429  max mem: 700\n",
            "2021/05/25 01:24:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:24:28\tINFO\t__main__\t * Acc@1 92.3600\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:24:29\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [  0/391]  eta: 0:07:04  lr: 0.0010000000000000002  img/s: 363.67947324924467  loss: 0.1137 (0.1137)  time: 1.0862  data: 0.7342  max mem: 700\n",
            "2021/05/25 01:24:41\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1143.9262767859236  loss: 0.1033 (0.1117)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:24:52\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.0042787950333  loss: 0.1102 (0.1143)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:25:03\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.5827070872315  loss: 0.1178 (0.1145)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:25:14\tINFO\ttorchdistill.misc.log\tEpoch: [159] Total time: 0:00:45\n",
            "2021/05/25 01:25:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.6455  data: 0.6211  max mem: 700\n",
            "2021/05/25 01:25:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:25:16\tINFO\t__main__\t * Acc@1 92.2800\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 01:25:17\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [  0/391]  eta: 0:07:14  lr: 0.0010000000000000002  img/s: 347.8846585504301  loss: 0.1070 (0.1070)  time: 1.1120  data: 0.7440  max mem: 700\n",
            "2021/05/25 01:25:29\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.0719912356276  loss: 0.1135 (0.1149)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:25:40\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1138.0942237899806  loss: 0.1137 (0.1147)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:25:51\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1147.1208505692114  loss: 0.1192 (0.1147)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:26:02\tINFO\ttorchdistill.misc.log\tEpoch: [160] Total time: 0:00:45\n",
            "2021/05/25 01:26:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5960  data: 0.5705  max mem: 700\n",
            "2021/05/25 01:26:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:26:04\tINFO\t__main__\t * Acc@1 92.3600\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:26:05\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [  0/391]  eta: 0:05:15  lr: 0.0010000000000000002  img/s: 464.3954936750907  loss: 0.1059 (0.1059)  time: 0.8064  data: 0.5308  max mem: 700\n",
            "2021/05/25 01:26:17\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1140.565261543299  loss: 0.1082 (0.1133)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:26:28\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1143.9457762909772  loss: 0.1072 (0.1127)  time: 0.1123  data: 0.0004  max mem: 700\n",
            "2021/05/25 01:26:39\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1139.817016443213  loss: 0.1091 (0.1123)  time: 0.1123  data: 0.0003  max mem: 700\n",
            "2021/05/25 01:26:49\tINFO\ttorchdistill.misc.log\tEpoch: [161] Total time: 0:00:45\n",
            "2021/05/25 01:26:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5801  data: 0.5534  max mem: 700\n",
            "2021/05/25 01:26:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:26:52\tINFO\t__main__\t * Acc@1 92.3300\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:26:53\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [  0/391]  eta: 0:07:47  lr: 0.0010000000000000002  img/s: 308.5943864852592  loss: 0.1236 (0.1236)  time: 1.1969  data: 0.7821  max mem: 700\n",
            "2021/05/25 01:27:04\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1144.61647620672  loss: 0.1125 (0.1185)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:27:16\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1146.2171333411616  loss: 0.1169 (0.1167)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:27:27\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1137.6191386343169  loss: 0.1097 (0.1160)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:27:37\tINFO\ttorchdistill.misc.log\tEpoch: [162] Total time: 0:00:45\n",
            "2021/05/25 01:27:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:55  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.7034  data: 0.6677  max mem: 700\n",
            "2021/05/25 01:27:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:27:40\tINFO\t__main__\t * Acc@1 92.3800\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:27:41\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [  0/391]  eta: 0:05:46  lr: 0.0010000000000000002  img/s: 352.33923003570834  loss: 0.1083 (0.1083)  time: 0.8860  data: 0.5226  max mem: 700\n",
            "2021/05/25 01:27:52\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1144.050597521267  loss: 0.1083 (0.1120)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:28:03\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1150.5477924315612  loss: 0.1091 (0.1122)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:28:15\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1142.6796896782914  loss: 0.1167 (0.1132)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:28:25\tINFO\ttorchdistill.misc.log\tEpoch: [163] Total time: 0:00:45\n",
            "2021/05/25 01:28:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:58  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.7419  data: 0.7157  max mem: 700\n",
            "2021/05/25 01:28:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:28:28\tINFO\t__main__\t * Acc@1 92.2100\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:28:29\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [  0/391]  eta: 0:07:17  lr: 0.0010000000000000002  img/s: 321.99323471693765  loss: 0.1652 (0.1652)  time: 1.1188  data: 0.7212  max mem: 700\n",
            "2021/05/25 01:28:40\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1141.4697926788042  loss: 0.1116 (0.1126)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:28:51\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.987035950796  loss: 0.1098 (0.1137)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:29:03\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1144.9386915983519  loss: 0.1095 (0.1134)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:29:13\tINFO\ttorchdistill.misc.log\tEpoch: [164] Total time: 0:00:45\n",
            "2021/05/25 01:29:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5578  data: 0.5335  max mem: 700\n",
            "2021/05/25 01:29:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:29:15\tINFO\t__main__\t * Acc@1 92.3700\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:29:17\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [  0/391]  eta: 0:07:09  lr: 0.0010000000000000002  img/s: 325.82100661023406  loss: 0.0992 (0.0992)  time: 1.0992  data: 0.7063  max mem: 700\n",
            "2021/05/25 01:29:28\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.4827245720512  loss: 0.1205 (0.1120)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:29:39\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.4707686751851  loss: 0.1019 (0.1123)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:29:50\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1141.4989166973196  loss: 0.1083 (0.1127)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:30:01\tINFO\ttorchdistill.misc.log\tEpoch: [165] Total time: 0:00:45\n",
            "2021/05/25 01:30:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:40  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5146  data: 0.4743  max mem: 700\n",
            "2021/05/25 01:30:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:30:03\tINFO\t__main__\t * Acc@1 92.3300\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:30:04\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [  0/391]  eta: 0:05:47  lr: 0.0010000000000000002  img/s: 326.1050067635984  loss: 0.1457 (0.1457)  time: 0.8881  data: 0.4955  max mem: 700\n",
            "2021/05/25 01:30:16\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1151.3916788195934  loss: 0.1100 (0.1132)  time: 0.1122  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:30:27\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1138.7580776874895  loss: 0.1182 (0.1143)  time: 0.1124  data: 0.0004  max mem: 700\n",
            "2021/05/25 01:30:38\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1134.0865704116013  loss: 0.1076 (0.1133)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:30:49\tINFO\ttorchdistill.misc.log\tEpoch: [166] Total time: 0:00:45\n",
            "2021/05/25 01:30:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5692  data: 0.5183  max mem: 700\n",
            "2021/05/25 01:30:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:30:51\tINFO\t__main__\t * Acc@1 92.3100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:30:52\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [  0/391]  eta: 0:05:40  lr: 0.0010000000000000002  img/s: 357.4180833124179  loss: 0.1111 (0.1111)  time: 0.8703  data: 0.5121  max mem: 700\n",
            "2021/05/25 01:31:04\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1149.4959029994711  loss: 0.1100 (0.1113)  time: 0.1126  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:31:15\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1146.912550923839  loss: 0.1159 (0.1130)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:31:26\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1145.9504540079488  loss: 0.1152 (0.1117)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:31:36\tINFO\ttorchdistill.misc.log\tEpoch: [167] Total time: 0:00:45\n",
            "2021/05/25 01:31:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5792  data: 0.5157  max mem: 700\n",
            "2021/05/25 01:31:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:31:39\tINFO\t__main__\t * Acc@1 92.2800\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:31:40\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [  0/391]  eta: 0:08:03  lr: 0.0010000000000000002  img/s: 331.5104592925212  loss: 0.0930 (0.0930)  time: 1.2364  data: 0.8502  max mem: 700\n",
            "2021/05/25 01:31:51\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1145.2537592340955  loss: 0.1025 (0.1107)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:32:03\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1138.736339302001  loss: 0.1093 (0.1127)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:32:14\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.5071981597248  loss: 0.1108 (0.1125)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:32:24\tINFO\ttorchdistill.misc.log\tEpoch: [168] Total time: 0:00:45\n",
            "2021/05/25 01:32:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5668  data: 0.5202  max mem: 700\n",
            "2021/05/25 01:32:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:32:27\tINFO\t__main__\t * Acc@1 92.4000\tAcc@5 99.7200\n",
            "\n",
            "2021/05/25 01:32:28\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [  0/391]  eta: 0:07:13  lr: 0.0010000000000000002  img/s: 311.32282081064295  loss: 0.1235 (0.1235)  time: 1.1083  data: 0.6971  max mem: 700\n",
            "2021/05/25 01:32:39\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1141.6057174813993  loss: 0.1135 (0.1131)  time: 0.1127  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:32:51\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1138.704940877035  loss: 0.1128 (0.1133)  time: 0.1120  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:33:02\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1148.77031052073  loss: 0.1105 (0.1129)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:33:12\tINFO\ttorchdistill.misc.log\tEpoch: [169] Total time: 0:00:45\n",
            "2021/05/25 01:33:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5986  data: 0.5317  max mem: 700\n",
            "2021/05/25 01:33:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:33:15\tINFO\t__main__\t * Acc@1 92.3500\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:33:16\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [  0/391]  eta: 0:06:50  lr: 0.0010000000000000002  img/s: 324.2068079267998  loss: 0.0793 (0.0793)  time: 1.0503  data: 0.6555  max mem: 700\n",
            "2021/05/25 01:33:27\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.421946584784  loss: 0.1068 (0.1122)  time: 0.1123  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:33:39\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1139.2171929474625  loss: 0.1066 (0.1125)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:33:50\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1138.9803399093264  loss: 0.1140 (0.1131)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:34:00\tINFO\ttorchdistill.misc.log\tEpoch: [170] Total time: 0:00:45\n",
            "2021/05/25 01:34:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5576  data: 0.5066  max mem: 700\n",
            "2021/05/25 01:34:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:34:03\tINFO\t__main__\t * Acc@1 92.3100\tAcc@5 99.7100\n",
            "\n",
            "2021/05/25 01:34:04\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [  0/391]  eta: 0:07:01  lr: 0.0010000000000000002  img/s: 333.7261382828676  loss: 0.1077 (0.1077)  time: 1.0772  data: 0.6936  max mem: 700\n",
            "2021/05/25 01:34:15\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1139.089086727376  loss: 0.1031 (0.1120)  time: 0.1129  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:34:27\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1142.6213225669828  loss: 0.1099 (0.1125)  time: 0.1126  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:34:38\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.6728437009376  loss: 0.1109 (0.1127)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:34:48\tINFO\ttorchdistill.misc.log\tEpoch: [171] Total time: 0:00:45\n",
            "2021/05/25 01:34:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:53  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6796  data: 0.6556  max mem: 700\n",
            "2021/05/25 01:34:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:34:51\tINFO\t__main__\t * Acc@1 92.2600\tAcc@5 99.6900\n",
            "\n",
            "2021/05/25 01:34:52\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [  0/391]  eta: 0:07:34  lr: 0.0010000000000000002  img/s: 327.7488144483461  loss: 0.1302 (0.1302)  time: 1.1634  data: 0.7729  max mem: 700\n",
            "2021/05/25 01:35:03\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1132.7370342160398  loss: 0.1039 (0.1116)  time: 0.1132  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:35:14\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1138.0676857330006  loss: 0.1096 (0.1129)  time: 0.1126  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:35:26\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1138.427260968214  loss: 0.1020 (0.1126)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:35:36\tINFO\ttorchdistill.misc.log\tEpoch: [172] Total time: 0:00:45\n",
            "2021/05/25 01:35:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6125  data: 0.5839  max mem: 700\n",
            "2021/05/25 01:35:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:35:39\tINFO\t__main__\t * Acc@1 92.3300\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:35:39\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [  0/391]  eta: 0:05:59  lr: 0.0010000000000000002  img/s: 326.3795813555365  loss: 0.1008 (0.1008)  time: 0.9182  data: 0.5260  max mem: 700\n",
            "2021/05/25 01:35:51\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1137.1637189322919  loss: 0.1111 (0.1141)  time: 0.1131  data: 0.0005  max mem: 700\n",
            "2021/05/25 01:36:02\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1143.6484810528357  loss: 0.1118 (0.1135)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:36:14\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1145.3294990058623  loss: 0.1025 (0.1120)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:36:24\tINFO\ttorchdistill.misc.log\tEpoch: [173] Total time: 0:00:45\n",
            "2021/05/25 01:36:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5581  data: 0.5109  max mem: 700\n",
            "2021/05/25 01:36:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:36:26\tINFO\t__main__\t * Acc@1 92.2700\tAcc@5 99.7100\n",
            "\n",
            "2021/05/25 01:36:28\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [  0/391]  eta: 0:07:23  lr: 0.0010000000000000002  img/s: 329.29835348036124  loss: 0.0848 (0.0848)  time: 1.1339  data: 0.7452  max mem: 700\n",
            "2021/05/25 01:36:39\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1137.2504374277132  loss: 0.1058 (0.1123)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:36:50\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1142.5580982580843  loss: 0.1048 (0.1133)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:37:02\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1141.001585459677  loss: 0.1151 (0.1124)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:37:12\tINFO\ttorchdistill.misc.log\tEpoch: [174] Total time: 0:00:45\n",
            "2021/05/25 01:37:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:55  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.7034  data: 0.6715  max mem: 700\n",
            "2021/05/25 01:37:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:37:14\tINFO\t__main__\t * Acc@1 92.2700\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:37:16\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [  0/391]  eta: 0:07:10  lr: 0.0010000000000000002  img/s: 298.23527366193764  loss: 0.1205 (0.1205)  time: 1.1022  data: 0.6729  max mem: 700\n",
            "2021/05/25 01:37:27\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1139.5097698782956  loss: 0.1034 (0.1119)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:37:38\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1142.9983819597023  loss: 0.1086 (0.1129)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:37:50\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1134.3429624245703  loss: 0.0967 (0.1120)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:38:00\tINFO\ttorchdistill.misc.log\tEpoch: [175] Total time: 0:00:45\n",
            "2021/05/25 01:38:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5850  data: 0.5637  max mem: 700\n",
            "2021/05/25 01:38:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:38:02\tINFO\t__main__\t * Acc@1 92.2700\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:38:03\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [  0/391]  eta: 0:07:07  lr: 0.0010000000000000002  img/s: 309.9881240804939  loss: 0.1288 (0.1288)  time: 1.0944  data: 0.6814  max mem: 700\n",
            "2021/05/25 01:38:15\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1146.60391647641  loss: 0.1077 (0.1127)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:38:26\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1137.2070765268081  loss: 0.1053 (0.1124)  time: 0.1124  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:38:37\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1139.7710398824713  loss: 0.1127 (0.1120)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:38:48\tINFO\ttorchdistill.misc.log\tEpoch: [176] Total time: 0:00:45\n",
            "2021/05/25 01:38:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5789  data: 0.5261  max mem: 700\n",
            "2021/05/25 01:38:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:38:50\tINFO\t__main__\t * Acc@1 92.2800\tAcc@5 99.7500\n",
            "\n",
            "2021/05/25 01:38:51\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [  0/391]  eta: 0:07:41  lr: 0.0010000000000000002  img/s: 352.0949848831642  loss: 0.1011 (0.1011)  time: 1.1809  data: 0.8174  max mem: 700\n",
            "2021/05/25 01:39:03\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1142.2153497891607  loss: 0.1015 (0.1116)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:39:14\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.7639899367648  loss: 0.1093 (0.1121)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:39:25\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1143.7946725127138  loss: 0.1101 (0.1128)  time: 0.1120  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:39:36\tINFO\ttorchdistill.misc.log\tEpoch: [177] Total time: 0:00:45\n",
            "2021/05/25 01:39:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5648  data: 0.5215  max mem: 700\n",
            "2021/05/25 01:39:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:39:38\tINFO\t__main__\t * Acc@1 92.3400\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:39:39\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [  0/391]  eta: 0:07:08  lr: 0.0010000000000000002  img/s: 317.6875025888585  loss: 0.1141 (0.1141)  time: 1.0949  data: 0.6919  max mem: 700\n",
            "2021/05/25 01:39:51\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1143.6046309017904  loss: 0.1064 (0.1137)  time: 0.1128  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:40:02\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1141.7003985215997  loss: 0.1028 (0.1116)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:40:13\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1144.5505908537586  loss: 0.1085 (0.1122)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:40:23\tINFO\ttorchdistill.misc.log\tEpoch: [178] Total time: 0:00:45\n",
            "2021/05/25 01:40:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:41  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5218  data: 0.4822  max mem: 700\n",
            "2021/05/25 01:40:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:40:26\tINFO\t__main__\t * Acc@1 92.3400\tAcc@5 99.7400\n",
            "\n",
            "2021/05/25 01:40:27\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [  0/391]  eta: 0:07:22  lr: 0.0010000000000000002  img/s: 322.2978772452214  loss: 0.1421 (0.1421)  time: 1.1325  data: 0.7354  max mem: 700\n",
            "2021/05/25 01:40:39\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1144.8800934890346  loss: 0.1003 (0.1110)  time: 0.1121  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:40:50\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1141.8023802839666  loss: 0.1016 (0.1108)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:41:01\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1141.5693058780503  loss: 0.1060 (0.1110)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:41:11\tINFO\ttorchdistill.misc.log\tEpoch: [179] Total time: 0:00:45\n",
            "2021/05/25 01:41:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.7125  data: 0.6833  max mem: 700\n",
            "2021/05/25 01:41:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:41:14\tINFO\t__main__\t * Acc@1 92.3600\tAcc@5 99.7600\n",
            "\n",
            "2021/05/25 01:41:15\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [  0/391]  eta: 0:05:47  lr: 0.0010000000000000002  img/s: 363.49455202573375  loss: 0.1070 (0.1070)  time: 0.8883  data: 0.5361  max mem: 700\n",
            "2021/05/25 01:41:27\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1138.1569550266906  loss: 0.0992 (0.1101)  time: 0.1124  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:41:38\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1144.809295442478  loss: 0.1121 (0.1117)  time: 0.1125  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:41:49\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1147.9351699010442  loss: 0.1032 (0.1117)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:41:59\tINFO\ttorchdistill.misc.log\tEpoch: [180] Total time: 0:00:45\n",
            "2021/05/25 01:42:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6014  data: 0.5422  max mem: 700\n",
            "2021/05/25 01:42:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:42:02\tINFO\t__main__\t * Acc@1 92.3000\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:42:03\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [  0/391]  eta: 0:07:19  lr: 0.0010000000000000002  img/s: 308.60556186902437  loss: 0.1296 (0.1296)  time: 1.1244  data: 0.7096  max mem: 700\n",
            "2021/05/25 01:42:14\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [100/391]  eta: 0:00:36  lr: 0.0010000000000000002  img/s: 1139.7492628061557  loss: 0.1047 (0.1101)  time: 0.1127  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:42:26\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [200/391]  eta: 0:00:22  lr: 0.0010000000000000002  img/s: 1140.8851997772933  loss: 0.1073 (0.1107)  time: 0.1122  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:42:37\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [300/391]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 1135.1824382900083  loss: 0.1056 (0.1113)  time: 0.1123  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:42:47\tINFO\ttorchdistill.misc.log\tEpoch: [181] Total time: 0:00:45\n",
            "2021/05/25 01:42:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5755  data: 0.5344  max mem: 700\n",
            "2021/05/25 01:42:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/25 01:42:50\tINFO\t__main__\t * Acc@1 92.3700\tAcc@5 99.7300\n",
            "\n",
            "2021/05/25 01:42:50\tINFO\t__main__\tTraining time 2:24:56\n",
            "2021/05/25 01:42:50\tINFO\ttorchdistill.common.main_util\tLoading model parameters\n",
            "2021/05/25 01:42:50\tINFO\t__main__\t[Teacher: densenet_bc_k12_depth100]\n",
            "2021/05/25 01:42:50\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:29:33  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.5374  data: 0.3859  max mem: 700\n",
            "2021/05/25 01:43:04\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:02:08  acc1: 100.0000 (95.1049)  acc5: 100.0000 (99.8002)  time: 0.0140  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:43:18\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:01:51  acc1: 100.0000 (95.3023)  acc5: 100.0000 (99.8001)  time: 0.0139  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:43:31\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:01:37  acc1: 100.0000 (95.3682)  acc5: 100.0000 (99.7667)  time: 0.0138  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:43:45\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:01:22  acc1: 100.0000 (95.4511)  acc5: 100.0000 (99.8000)  time: 0.0137  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:43:59\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:01:09  acc1: 100.0000 (95.4009)  acc5: 100.0000 (99.8000)  time: 0.0140  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:44:12\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:55  acc1: 100.0000 (95.4674)  acc5: 100.0000 (99.8334)  time: 0.0134  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:44:26\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:41  acc1: 100.0000 (95.4864)  acc5: 100.0000 (99.8572)  time: 0.0140  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:44:40\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:27  acc1: 100.0000 (95.4256)  acc5: 100.0000 (99.8500)  time: 0.0136  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:44:54\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:13  acc1: 100.0000 (95.4561)  acc5: 100.0000 (99.8445)  time: 0.0138  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:07\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:02:17\n",
            "2021/05/25 01:45:07\tINFO\t__main__\t * Acc@1 95.5300\tAcc@5 99.8600\n",
            "\n",
            "2021/05/25 01:45:07\tINFO\t__main__\t[Student: resnet20]\n",
            "2021/05/25 01:45:08\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:10:25  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.4226  data: 0.3933  max mem: 700\n",
            "2021/05/25 01:45:13\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:00:45  acc1: 100.0000 (92.1079)  acc5: 100.0000 (99.9001)  time: 0.0046  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:17\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:00:38  acc1: 100.0000 (92.3538)  acc5: 100.0000 (99.8001)  time: 0.0046  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:22\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:00:33  acc1: 100.0000 (92.3359)  acc5: 100.0000 (99.7667)  time: 0.0046  data: 0.0002  max mem: 700\n",
            "2021/05/25 01:45:27\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:00:28  acc1: 100.0000 (92.4269)  acc5: 100.0000 (99.7251)  time: 0.0045  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:31\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:00:23  acc1: 100.0000 (92.5415)  acc5: 100.0000 (99.7201)  time: 0.0046  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:36\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:19  acc1: 100.0000 (92.3846)  acc5: 100.0000 (99.7667)  time: 0.0050  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:41\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:14  acc1: 100.0000 (92.5296)  acc5: 100.0000 (99.7429)  time: 0.0045  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:45\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:09  acc1: 100.0000 (92.5384)  acc5: 100.0000 (99.7250)  time: 0.0048  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:50\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:04  acc1: 100.0000 (92.4897)  acc5: 100.0000 (99.7556)  time: 0.0046  data: 0.0001  max mem: 700\n",
            "2021/05/25 01:45:55\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:00:47\n",
            "2021/05/25 01:45:55\tINFO\t__main__\t * Acc@1 92.4600\tAcc@5 99.7500\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HUTCWU7PGB31"
      },
      "source": [
        "At the end of the training process, you will see improved accuracy of the student model (ResNet-20) compared to that trained without teacher in another example notebook and/or the accuracy reported in [the ResNet paper (Table 6)](https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/He_Deep_Residual_Learning_CVPR_2016_paper.pdf). "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "H04cv_LK833s"
      },
      "source": [
        "## 5. More sample configurations, models, datasets...\n",
        "For CIFAR-10/100 datasets, you can find more [sample configurations](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/configs/sample/) and [models](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/torchdistill/models/classification) in the [***torchdistill***](https://github.com/yoshitomo-matsubara/torchdistill) repository.  \n",
        "If you would like to use larger datasets e.g., **ImageNet** and **COCO** datasets and models in `torchvision` (or your own modules), refer to the [official configurations](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/configs/official) used in some published papers.  \n",
        "Experiments with such large datasets and models will require you to use your own machine due to limited disk space and session time (12 hours for free version and 24 hours for Colab Pro) on Google Colab.\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QuzcVbp99EDb"
      },
      "source": [
        "# Colab examples for training student models without teacher models\n",
        "You can find Colab examples for training models without teachers in the [***torchdistill***](https://github.com/yoshitomo-matsubara/torchdistill) repository."
      ]
    }
  ]
}